The herd of 12 elephants was following a calf in the area and suddenly started attacking the houses, police said.
Eight inmates, including three children, of the houses ran to safety.
Hearing the screams, some estate workers arrived and managed to scare away the elephants by making loud noises, they said.