The 74-year-old Oscar-winning star, who has been married three times, has told friends that he does not want to jinx her relationship with Perry by making him husband number four, reported the National Enquirer.
"The wedding's off and Jane's attitude right now is, 'If it ain't broke, don't fix it," a source said.
Since the pair started dating, they seriously considered tying the knot multiple times.
"But Jane said she could never find the time. She loves him too much to make him just another husband," the source added.