Ansari made the remark soon after the House met for the day when he took up the first listed question.
BJP members started shouting slogans on the land issue related to Robert Vadra, son-in-law of Congress President Sonia Gandhi.
BJP members were seeking a probe and reply from the government on the allegation of irregularities in some land deals in Haryana.
TDP members displayed shirts with slogan 'Save Andhra Pradesh, Save Democracy' in protest against decision to carve out a separate Telangana state.
Also Read
Ansari pleaded with the members to allow Question Hour while asking them to resume their seats.
As the din continued, Ansari said, "Every single rule in the rule book, every single etiquette is being violated...If the Hon'ble members wish the House to become a federation of anarchists, then it is a different matter."
Amid uproar, he adjourned the House till noon.
When the House resumed, Leader of Opposition Arun Jaitley expressed displeasure over Ansari's remark and demanded that the Chair should withdraw it. Ansari was not present at that time and Deputy Chairman P J Kurien was in the Chair.