The 57-year-old star says he would rather prefer to die while at work than play golf all day, reported Femalefirst.
"I'd rather drop dead at my job than retire. The idea of just playing golf makes me want to jump off a bridge. I'm going to work in my 80s or 90s if I can," Cowell told Daily Star.
Before becoming a music mogul, the "X Factor" creator worked as an estate agent in London's Mayfair and he said he "hated" the job.
"I was an estate agent for eight months and it was the most miserable time of my life. I worked for this really snotty company who hated me - and I hated them.