Scott Kingsley Swift told the One Direction star to "cool" his relationship with his country singer daughter, 23, after he told Taylor that he loved her during their break in Manhattan, reported Sun online.
Close friends say Scott, who has guided Taylor's career since she was a youngster, doesn't want the pair to end their romance but is just protecting his daughter's happiness.
"He likes Harry but he wants them to slow down and take things easy. It's clear to everyone they are smitten with one another and are already talking about marriage. He doesn't want them to split up," said a source.
The couple, who were seen kissing at a concert in New York on New Year's Eve, jetted to the Caribbean on New Year's Day and the pair already seem to have made the most of the sunshine.