The incident took place at Asha Dadri village.
Ranjit Giri escaped with handcuff after he requested the escort party to stop the vehicle to allow him to ease himself by the roadside, SP Varun Kumar Sinha said.
Raids are on to nab Giri who had allegedly raped a widow on Sunday last.