The tractor-trolley was heading towards Kurara area when the driver lost control of the vehicle and it overturned, they said.
Rekha (28), her two sons Pushpendra (5) and Jitendra (2) and the unidentified driver died in the mishap.
The bodies have been sent for postmortem, police said.