They were keeping up pressure in Nihm district, Sanaa province, after significant gains in Marib province, east of the capital.
The forces loyal to President Abedrabbo Mansour Hadi, and allied tribes in the area, have laid siege to Nihm's Fardha military, northeast of the capital.
Despite the proximity, the roughly 40 kilometres separating Nihm from Sanaa is mostly rugged mountainous terrain.
Yesterday, loyalists seized Hazm, capital of Jawf province, to the northeast of Sanaa.
Also Read
The two areas fell after clashes between advancing forces and Huthi rebels and renegade troops loyal to former president Ali Abdullah Saleh, said Ameen al-Ukaymi, a tribal chief of the Popular Resistance.
Government forces are now heading west, toward the contiguous rebel strongholds of Amran and Saada provinces, which lie immediately to the north of the capital, Ukaymi said.
Military sources said pro-Hadi forces, which are supported by a Saudi-led Arab coalition, brought reinforcements to Hazm today, including tanks and armoured vehicles.
US President Barack Obama said Friday there was an "urgent need for all parties to adhere to the ceasefire" after both sides repeatedly violated the truce aimed at helping the talks.
More than 5,800 people have been killed -- about half of them civilians -- and more than 27,000 wounded since March, according to the UN.