The four inmates broke the window of their remand home and fled last night, they said.
Two escapees, identified as Rajkapur Paswan and Sonu Sonal, were arrested later while efforts were on to nab Bablu Ansari alias Imran Ansari and Rakesh Singh.
Five policemen, posted at the remand home, had been sent to line duty as punishment by the Superintendent of Police M R Nayak.