Harris, 32, is said to be hurt by Swift's new romance, which came out just days after the musician announced his break-up from her, reported the New York Post.
"He's not happy about their relationship. He was hurt," a source close to Harris said.
"Looking back, some friends do feel like Taylor's team manipulated and orchestrated part of [her] relationship [with Harris] after seeing how public she is with her new guy. It makes sense."
Many people have indeed been speculating that Swift and Hiddleston's much-talked-about relationship isn't real, with the 26-year-old singer being the one orchestrating the whole thing. "I wouldn't put it past her. That's what they do. It's obvious," the source said.