The film written and directed by Jolie, 40, chronicles the story of an unhappy couple where the 51-year-old "World War Z" actor plays the husband, reported E! Online.
Jolie said filming the drama's intense argument scene was "heavy" as there was aggression.
"I'd be directing myself and him in a scene where we're having a fight, and I'd be pulling out the parts (of him) that have an aggression toward me or when you're frustrated with each other- it was very heavy," Jolie said.
"We kept joking that all of the crew felt like they were living in a house where the parents were fighting and you don't know where to stand or where to look."
"By the Sea" is about a deeply unhappy couple on vacation in France who becomes involved with a pair of newlyweds staying at their seaside inn.