The film was supposed to start in November, and it moved to March, clashing with the "Rise of the Planet of the Apes" director's another commitment, reported Deadline.
"I was very much looking forward to working with my friend Channing and the team at Fox, but regrettably a push in the start date now conflicts with another project. I thank them for the opportunity, and I know that Gambit will make a terrific film," Wyatt said in a statement.
Executives at the movie studio are reportedly looking to fill the director spot quickly.