The statement comes two days after a report of Catholic Secular Forum (CSF) said that Madhya Pradesh was the worst state when it comes to attacks on Christians.
Dr Cornelio said the Chief Minister Shivraj Singh Chouhan wanted harmony and peace and he was very particular about it, but some fringe groups were responsible for the attacks.
Asked if these incidents increased after BJP came to power in the state in 2003, and particularly after Chouhan took over the reins ten years ago, the Archbishop said fringe groups were responsible for the attacks and Chouhan could not be present everywhere (to prevent such incidents).
Saying that fundamentalists are present in every religion, Dr Cornelio said violence is unleashed in many parts of the world in the name of Islam, though that religion believes in brotherhood, peace and love.
The Madhya Pradesh Freedom of Religion Act prohibits religious conversion through force, allurement and fraudulent means. It also makes it punishable to change the religion without informing the authorities.