The four girls, aged between 13 and 18, hail from the Dhanuk sub-caste in Bhagana village of Haryana's Hisar district. They allege that they were gangraped after being kidnapped on March 23.
The victims and their families had been protesting at Jantar Mantar since April 6 demanding justice.
The protesters claimed that police and New Delhi Municipal Council (NDMC) officials arrived there around 6 AM and ordered them to leave the area by 12 noon.
Police, however, claimed that it was NDMC officials who had evicted them.
Also Read
The protesters later went to the Parliament Street police station along with some students to protest against the eviction.
"The 25 protesters who had reached Parliament Street police station, protesting their eviction, were detained by us but were later allowed to go," said a senior police official.
The eviction, meanwhile, attracted sharp criticism from Aam Aadmi Party (AAP), which termed it "extremely shocking".
The Lieutenant Governor and the Union Home Ministry should take immediate steps to ensure the safety of these four girls and their families, the statement added.