Azhar Ali told Geo News channel that they don't want to take part in a camp which includes Aamir, who served a ban for spot-fixing.
"But we are willing to discuss the matter with only the PCB Chairman Shaharyar Khan," Azhar said.
According to sources aware of the developments, Hafeez and Azhar reported for the camp in the morning session but did not return back for the second session.
The development comes just one day after the PCB pleaded with former players, critics and commentators who are against Aamir's return to the national team, to forgive the tainted fast bowler.
More From This Section
Amir's bid to make a comeback to the national side was given a major boost last week after he was invited for the national conditioning camp and also picked up in the Pakistan Super League players draft.
Hafeez had earlier turned down an offer from Chittagong Vikings to feature in the Bangladesh Premier League as the franchise had already signed Aamir.
The former captain said he could not share a dressing room with a player who has tarnished the image of Pakistan.
"It is not about individuals or any personality clash. It is about the image of Pakistan cricket. I cannot play with any player who has tarnished and brought a bad name to the country," Hafeez had told the media.
Raja, who is also the ambassador of Pakistan Super League (PSL), said that if he had powers to make a call on the matter, he would have never let Aamir play again.