Ganai, 65, block president of National Conference, was killed on June 15 in Natipora area of Srinagar city, while he was on his way to a mosque for Friday prayers.
"Chief Minister Omar Abdullah today visited the house of late Abdul Rehman Ganai," an official spokesman said.
The spokesman said Omar stayed with the bereaved family for some time, consoled them and "prayed for peace to the departed soul".
The chief minister condemned the killing of "an innocent person" and described it as a "heinous crime," the spokesman said.