Vice-principal of the medical college M A Rashid said the babies died since last night of broncho-pneumonia.
While two died in the Sick Neo-natal Care Unit, the other two died in general bed, he said.
Asked about complaints by parents that room heaters were not working, Rashid said that was because of prolonged power cut.
The Medical College and Hospital has been in news in recent past for frequent crib deaths.