Sanju and Jaiveer, facing charges of dacoity, climbed the wall when work was on to change fuse bulbs, they said.
"An FIR in this regard has been registered," Jail Suprintendent R N Pandey said.
A manhunt had been launched to nab them, the officials said.