The herd of six elephants from Gibbon Wildlife Sanctuary entered the Hindubari Division of the tea garden and destroyed the houses in the labour lines, official sources said.
No injury has been reported so far.
Attracted by the smell of fermented rice beer made in the houses, the elephants came there and looked for the alcoholic beverage by breaking down the houses, the sources said.
The forest department personnel were trying to guide the pachyderms back to the forest, they added.