"Taj Mahal ek khoobsurat kabristan hai (Taj Mahal is a beautiful graveyard," the Minister for health and sports in the BJP government in Haryana tweeted.
Vij has courted controversy several times in the past with his remarks.
His tweet on Taj Mahal came in the backdrop of Som, BJP legislator from Sardhana, Uttar Pradesh, questioning the monument's place in India's heritage.
Downplying the controversy over Taj Mahal, Uttar Pradesh Chief Minister Yogi Adityanath had said the monument was made by the blood and sweat of "Bharat Mata's sons" and its protection was the responsibility of his government
The 17th century marble monument was built by Shah Jahan for his wife Mumtaz Mahal. Both were buried there.