The family members of Babulal Meena (60) were asleep in their room last night when the speeding tractor hit the wall of their house, Hemraj Mund, SHO, Eklera police station said.
The accused Hansraj Meena was ploughing his field when the tractor went out of control, he said.
Arushi, Meesa and Mikki, aged between four to six years, died on the spot. Three other family members also received serious injuries in the incident, police said.
A case of negligent driving has been lodged against the driver, they said, adding efforts were on to trace him.