ANC secretary-general Ace Magashule told reporters that Zuma had "agreed in principle to resign and had proposed time frames extending from three to six months".
But Magashule said there was no date for Zuma to stand down, and added that there would be "continuing interaction" between party officials and Zuma.
"In its wisdom, the NEC (National Executive Committee) decided... to recall its deployee Jacob Zuma," Magashule told reporters.
The ANC party can "recall" the head of state, but the process is a party-level instruction and he is under no constitutional obligation to obey.
More From This Section
The ANC said Zuma would respond to the recall decision tomorrow.
The power struggle over Zuma's departure has put the president at loggerheads with Cyril Ramaphosa, his expected successor, who is the new head of the African National Congress.
The ANCs leadership committee met for 13 hours at a hotel outside Pretoria, and decided in the early hours of today to "recall" Zuma from his post.
"We just felt he meant three months of looting," the source said, speaking on condition of anonymity.
The political deadlock has plunged South Africa -- Africa's most developed economy -- into confusion over who is running the country, with a series of public events cancelled last week including the annual State of the Nation address to parliament.
"We know you want this matter to be finalised," Ramaphosa, 65, told a party rally in Cape Town on Sunday.
South African opposition parties have called for early elections as the ANCs leadership battle grinds on.
An opposition request for a no-confidence vote against Zuma, 75, this week was still being considered by the parliamentary speaker.
Zuma's presidency has been marred by corruption scandals, slow economic growth and record unemployment that have fuelled public anger.
He was scheduled to stand down next year after serving the maximum two terms after coming to power in 2009.
In 2008, Zuma's supporters pushed out then-president Thabo Mbeki via a "recall" over allegations of abuse of power.
The party faces a tricky general election next year.
Ramaphosa is a former trade unionist and Mandela ally who led talks to end apartheid in the early 1990s and then became a multi-millionaire businessman before returning to politics.
Zuma's hold over the ANC was shaken in December when his chosen successor -- his former wife Nkosazana Dlamini-Zuma -- narrowly lost to Ramaphosa in a vote to be the new party leader.
The ANC has insisted there will be no delay to the budget speech, which is due on February 21.