Scindia also hit out at the BJP alleging that since the party came to power, there has been an atmosphere of intolerance in the country.
Incidents of vandalism of statues in certain parts of the country have been reported in the last couple of days.
A statue of Lenin was brought down at Belonia town in South Tripura on Monday with the help of a bulldozer after the BJP's victory in the Assembly elections in the north-eastern state where a 25-year-long communist government was ousted.
A bust of Jan Sangh founder Syama Prasad Mookerjee was also vandalised today in south Kolkata by seven persons, including a woman, allegedly belonging to a left-wing group 'Radical'.
More From This Section
"It can be anybody's statue, but if you are demolishing statues, then you are desecrating the country's culture and civilisation," Scindia told reporters here, when asked about the incidents in Tripura and other parts of the country after the BJP came to power.
"An atmosphere of intolerance is prevailing in the country after the BJP came to power," he said.
Modi also spoke to Home Minister Rajnath Singh on the matter and expressed his strong disapproval of such incidents, according to an official statement.
Scindia said, "I am more surprised as those who are indulging in it (referring to vandalism of statues) and those opposing it are from the same party."
"In both these incidents, if anyone is guilty then it is the BJP workers," he charged, adding that "no steps are being taken to check them."
"Whatever is happening in the country is part of a well thought out conspiracy to damage its liberal and secular character," the former Union minister said.
"I think when you occupy a public post, then you should be able to say what is right, is right, and what is wrong, is wrong, to anyone whether they belong to the ruling party or the opposition," he said.