"The ordinance is not proper...Rahul Gandhi has spoken the right thing," Kumar told reporters on the sidelines of a function here.
"If you stop an improper action at any stage it does not lower your prestige, but enhances it," he said.
"As the ordinance is facing criticism across the country, the right step will be its withdrawal. There is still time left as President has not given his approval to the ordinance," he said.
Asked if the ordinance has been aimed at helping RJD chief Lalu Prasad who will face a judgement in fodder scam on Monday, Kumar said "it's obvious.