Pattinson and three others were dropped for the third Test after they failed to make a presentation on how they can improve their performance, to coach Mickey Arthur.
"It shows a lack of respect to the coach, the captain as well, and the rest of the team. I know if I was in their position, as a team member, I'd be quite disappointed in them for being a bit selfish," Pattinson was quoted as saying by Australian media.
Watson even said that he was contemplating his future but Pattinson said what they did was unacceptable.
"People talk about it as a harsh punishment but looking deeply into it you realise probably it's not. If you want to be part of the Australian cricket team you have to do everything right. It's not acceptable. I believe it's the right punishment," the tall paceman added.
"You've got to do everything right. It wasn't hard for the other 12 blokes to get it in on time and they took the time out to really reflect and do what's best for the team whereas us four didn't. Right now I'm still hurting about it but in the long run I think it's going to make us a better team," he said.