Kejriwal said they will continue their protest at Parliament Street till Khurshid is removed from the Cabinet and arrested along with his wife for alleged irregularities in the functioning of a Trust run by the minister and his wife Louis.
Both Khurshid and wife have denied the charges.
Police announced the release of Kejriwal and others, including disabled people, who were detained at the Rajiv Gandhi Stadium in Bawana since last evening after they were picked up from Janpath during their protest.
"We have released them from detention," Delhi Police spokesperson Rajan Bhagat said.
Besides Kejriwal, the others who were detained included Manish Sisodia and Gopal Rai.
Kejriwal sought to up the ante by calling for throwing the UPA government out of power.
He tweeted, "Rise and throw this corrupt empire. Bhagat Singh gave up his life for the country. Subhash Chandra Bose gave up his life and career. What would u do?
"My appeal to the youth - come and join. You are not doing favour to anyone. Fight for ur own future. Parliament Street police station (will be the) beginning of downfall of corrupt empire. Parliament Street police station will be the next Tahrir Square," he said.
