The 'Toxic' singer quit as a judge after just one season on the show and Lovato is devastated she won't be working with Spears again, although she has come up with a suitable replacement, reported Us magazine.
"I wish Britney would come back. My next pick is Lady Gaga though, she's so cool," Lovato said.
Lovato and Simon Cowell are the only remaining members of the panel after LA Reid also quit at the end of last season.
Actress Jennifer Love-Hewitt and singer Kelly Rowland have been rumoured as possible replacements to join the panel in 2014.