Zarif spent around 10 minutes at the Harmandir Sahib, popularly known as Golden temple, where a large number of people greeted him.
When asked about strain in ties between India and Pakistan, Zarif only said Iran was ready to work with both the countries.
Prime Minister Narendra Modi and Afghan President Ashraf Ghani had visited the Golden temple yesterday evening.
The temple premises here were decorated with lights and flowers in view of scheduled visits of Modi and foreign dignitaries.