The visit is taking place when Pakistan parliament is mulling a request by Saudi Arabia to provide troops, jets and warships to join its coalition fighting in Yemen against Shia Houti rebels, allegedly supported by Iran.
Defence minister Khawaja Asif said that Zarif would be in Pakistan today.
The agenda of Zarif's visit has not been released, but according to informed sources he will meet Prime Minister Sharif and advisor on foreign affairs Sartaj Aziz to discuss the conflict in Yemen.
The Turkish President yesterday visited Tehran and held talks with Iranian leaders on the Yemen.
More From This Section
Sharif yesterday asked Iran to get involved in talks on security in Yemen as parliament debated whether Pakistan should join the Saudi-led operation.
Sharif had told parliament that he was waiting for a message from the Turkish leader after his visit to Tehran to take more steps for tackling the problem.
He also has a plan to involve the leaders of Indonesia and Malaysia to help cool the situation.
There is growing concern in the Muslim world that the Yemen crisis may deepen the sectarian divide and may endanger the peace and stability in other countries, mostly having both Sunni and Shia populations.