Mohammad Shamshaad was arrested from the Old Delhi Railway station following a complaint about a nine-year-old girl gone missing from the area, they said.
"On the intervening nights of Thursday and Friday, Shamshaad and the girl were spotted at the Old Delhi railway station after which he was arrested and the girl rescued," Deputy Commissioner of Police (South-East) P Karunakaran said.
Shamshaad had abducted and raped a minor girl in March and later abducted three other minor girls from the same Govindpuri area.
While the first case was reported in March, the other two cases were reported in July and August respectively.
Sections of Protection of Children from Sexual Offences (POCSO) were added in all the complaints against him, police said.
As per police, Shamshaad has admitted his obsession for minor girls which prompted him to commit these crimes.