The attack on the teacher took place around 8:00 pm (local time) yesterday in the city's 13th district, police prefect Laurent Nunez said.
The 57-year-old victim, who was wearing a kippa, was attacked outside his home, a short distance from the school and synagogue complex, a source close to the investigation said.
The attackers who were travelling by scooter demanded he look at smartphone pictures of Toulouse jihadist Mohamed Merah, who shot dead three Jewish schoolchildren, a teacher and three soldiers in southwestern France in 2012, Marseille public prosecutor Brice Robin said.
The teacher, who escaped serious injury, was taken to hospital as officers fanned out across the district to search of the attackers, who fled when a police patrol arrived in the area.
More From This Section
"I'm very shocked because this is the second incident of its kind in a very short time," Michele Teboul, the regional president of the Jewish representative group CRIF said, adding she was "worried" about the threat of further attacks.
Yesterday's stabbing comes as France is on high alert following the Islamist attacks that killed 129 people in Paris on Friday.
The terror attacks, which were claimed by the Islamic State jihadist group, were the worst in French history.
Parliament is due today to begin debating a three-month extension of the state of emergency declared over the violence.
French Muslims meanwhile fear blowback from the attacks.
Yesterday, a young woman in a headscarf was attacked as she was leaving a metro station in central Marseille by a man whom she said accused her of being a terrorist.