Producers have confirmed that the Kardashian sister will no longer host the series, but co-host Mario Lopez will be back for the new season, the MTV News reported.
"We really enjoyed working with her and wish her all the best in her future endeavors," a spokesperson for the show said in a statement.
Simon Cowell said that he's excited to welcome Lopez back to the show along with returning judge Demi Lovato.
"I'm thrilled Mario is back for season three of 'The X Factor.' Hosting a live show and keeping the judges - especially Demi - in line is not an easy job, but Mario is a pro and we are glad he's coming back," he said.
The judging panel has also witnessed an overhaul this year with Britney Spears and LA Reid opting out of the show.