The Oasis star topped Simon Cowell's hit list to replace Gary Barlow but he has turned down the offer fearing it would kill his career, reported Daily Star.
"Noel thinks it would be bad for his music if he joined. Noel has told pals he doesn't need the fame or the money and his fans wouldn't be impressed," a source said.
Instead, Barlow will return with Nicole Sherzinger, Louis Louis Walsh and Sharon Osbourne.