Cheryl, 30, is said to be worried about her life being in the spotlight despite being media mogul Simon Cowell's desires of luring the singer back, reported Daily Mirror.
"Cheryl has happy memories of The X Factor - she won it twice and loved mentoring her acts. But she didn't have any time to herself and doesn't want the media circus around her like before," a source said.
"At that time her relationship with Ashley was in tatters and she was living her life in the limelight every day. This is where her quandary lies. She and Simon are friends again and have been in one another's company several times since they stopped working together. However, Cheryl has never been happier," the source added.