Yadav, who has been warming up to the BJP for sometime praised its prime ministerial nominee Narendra Modi as a "strong leader" and said that the country needs bold leadership this time.
He was talking to reporters at his residence after submitting a letter to President Pranab Mukherjee.
In his communication to the President, Yadav said that he withdraws his support from Union Council of Ministers headed by Prime Minister Manmohan Singh.
Yadav had defeated Bihar strongman and former RJD MP Shahabuddin's wife Heena Saheb from Siwan seat in the 2009 Lok Sabha elections.
Also Read
In the letter, Yadav also touched upon issues like rising prices of essential commodities and alleged rampant corruption during the UPA regime.
"As you are aware, the country is going through a worst phase with regards to astronomical increase in the price of essential commodities very badly affecting the common man of the country. Besides, there is rampant corruption at all levels of the government," the letter stated.
Copy of this letter has also been marked to the Prime Minister.
Yadav's letter levelling allegation of political vendetta on the UPA government comes a day after the centre decided to set up an enquiry commission to probe snoopgate in Gujarat which has been strongly resented by the BJP.