The protesters, led by Youth Congress president Amrinder Singh Raja, converged on South Avenue and started marching towards the Prime Minister's residence shouting slogans and holding anti-government placards.
They demanded that Swaraj be sacked with immediate effect for providing assistance to Lalit Modi with the travel documents.
"On one hand, the Modi government is claiming to bring back blackmoney and on the other, they are helping people like Lalit Modi, who is involved in big scams," spokesperson of Youth Congress Prateek said.
A posse of security personnel barricaded the route to the PM residence after which the protestors set out for Swaraj's residence at Safadarjung Lane.
More From This Section
Police halted protesters' march near Chanakyapuri police station, where they burned the effigy of the Prime Minister.
Few protesters, who tried to forcibly cross the barricades, were detained by the cops.
Congress has been attacking Swaraj for 'helping' fugitive former IPL boss Lalit Modi, who faces trial in India in several cases of financial irregularities, secure travel documents in UK.