The victim, identified as Husain aka Haasu, had gone for the morning prayers when one Nasibu along with his three associates accosted and stabbed him, they said.
Old enmity was stated behind the murder, police said.
Husain succumbed to injuries while on the way to hospital, they said.
The body has been sent for postmortem and further investigation is underway, they said.