Rajnath Singh will lead the BJP into the 2014 Lok Sabha polls, and the meeting assumes significance as Modi is one of the prominent contenders for the prime minister's post from the party.
The party has kept quiet on its choice for the top post.
The meeting, however, was described as a "courtesy call", with Modi tweeting he was going to meet the new party president to "congratulate" him.
"Leaving for Delhi...Will meet Shri Rajnath Singh ji & congratulate him on his taking over as BJP president," Modi tweeted in the morning.
Rajnath Singh was unanimously elected BJP president Wednesday, replacing Nitin Gadkari at the last moment. Gadkari had to let go a second term at the last minute because of charges of financial irregularities in companies involved with Purti Group, with which he has been associated.