"Khurshed Alam Khan, in addition to being an able and efficient administrator, was also a sensitive and dashing politician," Kumar said in his condolence message.
"Khan discharged responsibility in different ministries at the Centre and displayed high level of administrative capability," Kumar said.
The deceased, who is the father of External Affairs Minister Salman Khurshid, also functioned as Governor of Goa, Maharashtra and Karnataka, the Bihar chief minister said.
He expressed grief over Khan's death and said he would pray for the family of the departed leader.