Jaitley is a Rajya Sabha member from Gujarat.
Sinha, who has been criticising the Modi government's economic policies, during an interaction with reporters here, also alleged that the GST was rolled out without giving due consideration to each and every aspect.
Indian economy received "two shocks" in the form of demonetisation and GST in quick succession, said Sinha, a former union finance minister.
"Our finance minister is not from Gujarat, as he was elected to Rajya Sabha from here. And, he is a burden on the people of Gujarat. If he was not elected from here, a Gujarati would have got the chance," Sinha said while responding to a question.
More From This Section
Sinha said the finance minister believes in only one rule, "that is 'chitt bhi meri patt bhi meri', means heads I win, tails you lose."
"He cannot take credit for imposing on the country a deeply flawed tax system, and people of this country are well within their right to demand that he should lose his job," the veteran leader said.
On Jaitley's earlier remark that Sinha is looking for a job at the age of 80, Sinha, who insisted that he is not part of any 'Margdarshak Mandal', said he is still fit unlike those "who give their speech while sitting", an apparent reference to Jaitley, who had sat down in between his budget speech due to health reasons.
Without taking any name, Sinha said attempts were made by some people to create a rift between him and his son- Minister of State for Finance Jayant Sinha.
"Though some people had made attempts to create a rift between us, they did not get any success," Sinha said in a reference to the political storm that erupted after his article, criticising the Modi government over the state of economy, was published in a newspaper in September.
In that article, Sinha, who was the finance minister under the Atal Bihari Vajpayee-led NDA government, had criticised Jaitley over the "mess the finance minister has made of the economy" and said he would be failing in his national duty if he did not speak up.
"Go back in history and you will find that Jaitley himself had said that we will progress towards a single tax structure. That is what he had said. But when others are saying it, it is childish, and when he said it, it was mature," said Sinha.
The BJP veteran also claimed that the decision of demonetisation has failed to serve its purpose. He also accused Modi of shifting goal posts.
"There is still a question mark on the success of demonetisation. Be it black money, or fake currency or eliminating terrorism, all these problems are still there."
He even suggested to form a committee under the guidance of GST architect and former chairman of 13th Finance Commission, Vijay Kelkar, to find out the flaws and include the suggestions of that committee in the next union Budget.