The grubby ex-Libertine wound up Moss so much when they were together that she battered him around the head with a guitar and set fire to his favourite childhood teddy, reported Sun Online.
"Maybe we could have lasted forever. When I met her she was just a girl from south London that I fell in love with. But it wasn't an easy love. In a different world, at a different time - if we hadn't become famous it might have worked. But with all the people around us it just couldn't. They didn't want us together," he said.
The singer admitted he has not been able to hold down a proper relationship since his 2007 split with Moss.