Chris Gayle, Dwayne Bravo, Darren Sammy and Andre Russell are in Australia but playing in the Twenty20 Big Bash League while their national side struggles.
The West Indies were overpowered by an innings and 212 runs by the home side inside three days in the first Test in Hobart.
"I'm totally frustrated," Simmons told reporters ahead of the second Test starting at the Melbourne Cricket Ground on Saturday.
"It's enjoyable to see Russell bowling at 140 clicks (kph) and (batsman Dwayne) Bravo hitting three or four sixes and Chris (Gayle) in (the Big Bash).
Also Read
Simmons, who was suspended in September after criticising selection for the tour of Sri Lanka before being reinstated last month, said it was a dilemma the Caribbean bosses had to resolve.
"It's up to the administration to work out how we get to the stage of, let's say New Zealand, because they have similar things and they are getting all their players to play," Simmons said.
"And it's up to our administration and our bosses to find out how is the best way that we can get these guys on the pitch."
"Times change and I think that is one of our problems, we tend to hold on too much to the past and not focus on the future. That has been our downfall," he said.
"It's painful to see the state of our cricket."
Bravo has not been picked for one-dayers since and quit Test cricket this year after being ignored by selectors.
"Those in charge have to look into themselves. The relationship between players, board members and management staff -- it needs to get stronger and tighter. They (the board) need to have a lot more honesty," he said.
Simmons said he and his coaching staff had been exhorting the players to push to their maximum against Australia.
"Your body language always tells something to the other team, so it's something that -- especially (bowling coach and Test great) Curtly Ambrose -- keeps trying to preach to them," he said.
"It's part of the game and you need to show the other team that you're in this. It's something we keep talking about.