Beria, who was the Minister for Textile and Sericulture Industries, said the chief minister has every right to remove any minister but he had not expected such an action against him.
Beria said he respected the chief minister's decision but expressed disappointment that he was never once asked about the work he had performed as a minister.
Stating that he had won three out of five elections which he had contested from the party, Beria said he would not leave Samajwadi Party.
He was among five ministers who were dropped from the Cabinet by Yadav as part of a major rejig of the government ahead of a possible reshuffle.
Meanwhile, other SP leaders said Beria had failed to address the grievances of masses, which was the reason for his removal from the cabinet.