The new gallery will be able to accommodate over 5,000 visitors.
Built at the cost of Rs 16.39 crore, the foundation stone of this gallery was laid down by then home minister, P Chibambaram, on October 22, 2010.
Everyday, a large number of people come to witness the retreat drill here where the BSF sentinels and Pakistani Rangers exchange hostile gestures.
The visitors' gallery which was earlier in existence was not sufficient to cater to the needs of the swelling number of visitors.
Earlier, Rajnath and the chief minister paid floral tributes at the 'samadhi' of freedom fighters Bhagat Singh, Rajguru, and Sukhdev, an official release said.
Later, they drove to the JCP, where they addressed BSF jawans and visited the BSF museum where the original pistol belonging to Bhagat Singh -- which was used in killings of British police officer John P Saunders -- has been kept, they said.