The Take That star, whose final group Rough Copy was eliminated in the semi-final, said that his three losses are "a reason to come back", reported Digital Spy.
"I'm disappointed. That's a reason to come back somewhere in the future, maybe. Not next year. It's been nice, I've had three beautiful years on the show. I've really enjoyed it. I've met some friends, friends for life, but it's time to go," Barlow said.
Asked if Take That bandmate and former rival Robbie Williams could be taking his spot, Barlow said, "I would love to see him on this show. I'd love to see him on ITV2 - the best and worst bits. That would be brilliant.