Upadhyay presented Nepal's indigenous handmade 'PAUA painting' to Madhav during the meeting.
It is his second stint to India as he was recalled by the previous K P Oli government before being re-appointed by Prime Minister Prachanda.
Arjun Narasingha K C, Nepal's Urban Development Minister, also met Madhav.