"The chief minister has directed to suspend Chief Medical Superintendent Himanshu Yadav and head of the Pediatric department Rajeshwar Dayal with immediate effect," an spokesperson said.
Yadav has also directed to remove the college's principal, A K Agarwal, and appoint S K Garg in his place.
The infants had allegedly died as electricity went off on Monday.
The Chief Minister has also asked the local administration to initiate a probe into the matter and submit a report to him at the earliest.