The move was taken after a departmental inquiry found that Singh and his aides sanctioned work worth crores of rupees by blatantly flouting tender norms, officials said.
It was found that he awarded contracts at high rates and made payments without verifying the work, they said.
An FIR was also filed against Yadav's aide project engineer Ramendra.
Two contracting agencies, Tirupati Constructions and JSP constructions, have also been booked in the case lodged at Sector 39 police station.
Meanwhile, a police team today went to Yadav's house to arrest him but he was not found there, the officials said.