Abid Sher Ali also claimed that the poor performances were the result of politics in the team.
"The players indulge in groupings and politics and try to demean each other even on the field. It is time such elements were kicked out of the team," he said in Faisalabad during a Pakistan Day ceremony for police martyrs.
Sher Ali said all such players were a bad influence on Pakistan cricket.
The minister for power and water also felt that since Shahid Afridi and Waqar Younis were big names in Pakistan cricket they themselves should announce their retirement and resignations instead of waiting for the authorities to sack them.
Also Read
Other political figures have also condemned the performance of the team and called on the Prime Minister, Nawaz Sharif to take measures to put cricket affairs on the right track.
Opposition leader, Syed Khursheed Shah said the team had let the nation down continuously and the players appeared to be playing without any pride or passion.
In Pakistan, the Prime Minister is the patron-in-chief of the cricket board and nominates the candidates who can stand for the election of the post of PCB Chairman under the new constitution.
Present chairman Shaharyar Khan and his second in command, Najam Sethi who also remained Chairman and now heads the executive committee were both brought in by Nawaz Sharif to run cricket affairs.
The former Chairman of the PCB and a senior bureaucrat, Khalid Mahmood and former chief executive, Arif Ali Khan Abbasi urged the Prime Minister to take to task all those responsible for the steep decline in Pakistan cricket.