About 10 families, mostly labourers, were living in the premises of the building, according to Hyderabad Mayor B Rammohan.
Telangana Home Minister N Narsimha Reddy and several other leaders and officials rushed to the spot where rescue work is underway.
Reddy said violation of rules has been noticed in the construction of the building.