He had been in the Kenyan capital earlier this week en route for South Africa. At the time South African officials said they were unaware of the former leader's impending trip.
"According to his family he has left Nairobi and returned to Cameroon," said Bozize's adviser, who asked not to be named.
Bozize's spokesman on Tuesday said he had left Cameroon on a "private visit" without specifying his destination.
The 66-year-old fled the Central African Republic to Cameroon after a rebel coalition seized power on March 24 in the latest coup in the chronically unstable nation.
More From This Section
But the Economic Community of Central African States "decided it was best to accommodate him where he was, in Cameroon."
The small west African country of Benin had also offered him asylum.
"We are not in the business of jostling for who takes over the former president. There were many offers from his region and others very close by," said Nkoana-Mashabane.
She refused to speculate on whether South Africa would arrest Bozize if he lands in the country after the interim government in Bangui secured an international warrant for crimes allegedly committed during his 10 years in power.