"He (Speaker) has destroyed the prestige of the position he holds. After using derogatory language against me, he should not stay as Speaker even for a minute," said the Janhit Congress leader.
The Haryana Assembly Speaker had called Bishnoi "fukra" (loafer).
Bishnoi said he intends to meet Lok Sabha Speaker Meira Kumar to seek removal of Sharma.
The Speaker had made the comments after dismissing a petition of HJC seeking disqualification of five party MLAs who had crossed over to Congress.
Bishnoi said the Speaker's decision was not surprising as Sharma had been openly declaring that he was a Congress man when he was supposed to be neutral.