Police said there was a minor scuffle between the man and the group, following which he fell unconscious and died at a hospital due to cardiac arrest on Wednesday night.
The miscreants had allegedly made some remarks when V Ramesh was riding a bike along with his son and daughter.
"There was a minor scuffle between Ramesh and the group on the issue. He suddenly suffered a heart attack and fell down unconscious," Chavakkad Circle Inspector A J Johnson said.
IPC 304 (punishment for culpable homicide not amounting to murder) had been slapped against the accused, who are absconding now.
A man hunt is on to nab the culprits and they will be arrested soon, the officer added.