"There have been lapses from the side of the police in not being able to arrest him," the chief minister told reporters.
Nurul Islam, the officer-in-charge of a police station in Ampati, allegedly molested and raped the two minor sisters last month.
He was arrested on June 1 after an FIR was filed.
The same night he escaped from a government quarters where he was being held.
Asked if Islam has been dismissed from service, the chief minister said, "There are provisions of law which are being followed ... The important question is to get the culprit and punish him as per law.