The 48-year-old, who raises six kids with actress Angelina Jolie, also said that he might quit acting, reported Mirror online.
"I want it to be worthy enough of a story to leave the family, you know? They're everything. The family is first. I also don't want to embarrass them," he said.
The actor says he prefers to producing films rather than directing.
"I'd rather be behind the camera these days," Pitt added.