The 61-year old Sharma would be administered oath of office and secrecy by President Pranab Mukherjee tomorrow. Sharma a 1976-batch Bihar cadre IAS officer is currently the Defence Secretary.
Rai, who earlier drew flak from government and ruling parties for holding press conferences and interacting with media, today thanked media persons just before demitting office today.
"It is because of all of you that this institution has been able to function independently. I hope you continue to extend support to the institution," he said, but did not take any questions.
Like Rai, Sharma too has served as Secretary in the Department of Financial Services. He has spent over 10 years in the Defence Ministry in various capacities.
The CAG is appointed for a term of six years or till the incumbent attains the age of 65 years, whichever is earlier.