In a veiled attack on Congress, Naqvi also alleged that since Independence funds meant for welfare of minorities were not well spent and "looted" by middlemen and "power brokers".
"There was a competition among the so-called secularists to exploit these communities politically. Due to such approach, development of minorities especially Muslims has remained on paper only," he said.
Minority communities, especially Muslims, should assess the central government on the basis of its work and not from the eyes of those people who are responsible for political exploitation of the Muslim community, he said.
Naqvi was speaking at the inauguration of Central Waqf Bhawan, where Cabinet Minister for Minority Affairs Najma Heptulla was also present.
"Much has happened in the past six decades but it can be clearly seen that justice has not been done with regard to socio-economic and educational empowerment of minorities. There can be vote-bank politics behind it or other things, I don't want to delve into it," Naqvi claimed.
He said judging from the "amount spent since Independence" in the name of education, development and empowerment of minorities, there "should not have been a single person" belonging to these sections, below the poverty line.
"The money was not spent well and middlemen and power brokers continued to loot that money. We need to control such elements and this government has done that," Naqvi alleged.
He said it was a "priority" of the Modi government to ensure that every penny is well spent for the benefit of the people. Naqvi also said that he had travelled to several states but the impact of money spent by states "cannot be seen" on the ground.
Accusing the previous Congress-led government of talking only about the sentiments of minorities, Heptulla said the sentiments of majority community should also be taken into account.
"I have one principle in life, I should not hurt anybody's sentiments. You are talking about the sentiments of minority community. Shouldn't we also think of the sentiments of the majority community," Heptulla said when asked about the issue of ban on beef.
The minister said there are people who have special feelings for cow, and those sentiments of the majority community should also be respected.
"What is there, after all, in food? You can eat anything. But if you are prohibited to eat one thing why should you feel so hurt? By hurting some other people's sentiments you eat it, it is not fair. I am of that view.
"Unfortunately, the previous government had always talked of the sentiments of minority. But, we should also look at the sentiments of my neighbour," she said.