Two construction workers from Uttar Pradesh and a two-year-old baby playing near the one-storey building died when its mud walls collapsed, they said.
The mud walls of building may have been weakened by the recent downpour in the city, officials said.
Five fire tenders were engaged in rescue and relief work, they said.