"Modi had compared Kerala to Somalia, which is infamous for starvation deaths and sea pirates. The pride of Keralites has been hurt," Antony told reporters after exercising his franchise at a booth here.
"The Prime minister had an opportunity to apologise for the remark, but he did not do that," the former Defence Minister said, adding the remark would affect the BJP's prospects.
However, BJP defended the Prime Minister, saying people were "twisting facts" and he had only highlighted the plight of the tribal community in the state and his desire was to improve their living conditions.
Expressing confidence that Kerala will create history by voting to power the UDF government again, Antony said the Marxist-led LDF will have to sit in the opposition for the next five years and BJP will not open its account.
This will be a vote against the politics of violence and communalism and it will be a vote for peace, he said.