The "X-factor" boss jokingly said that the boys including Harry Styles, Louis Tomlinson, Liam Payne, Niall Horan and Zayn Malik were like "excited puppies," reported Aceshowbiz.
"They were like five puppies - really excited, loads of opinions, always wanted to hang out," Cowell said.
Reacting to his "nightmare" comment Tomlinson laughed, saying, "I'm sure we were a nightmare. We were at the height of our immaturity, always running around and being mischievous. There were so many meetings where Simon had to snap us to attention, but he was very patient."
"I don't know if it's a hiatus or a breakup, to be honest ... In a weird way, I don't want to know ... They'll decide when they want to come back together," he said.