The pilgrims were on their way back home from Pirana Pir when the vehicle they were travelling in collided with another vehicle coming from opposite direction. Their vehicle overturned and fell into a roadside ditch, they said.
The injured were rushed to Malda medical college and hospital, police said.
While four persons died on the spot, another died at the hospital, they said.