However, details are not available right now, Thakur told PTI.
The couple was kidnapped on Friday while they were returning home by car from Giridih in neighbouring Jharkhand where they had gone to attend a wedding function.
Their abduction, allegedly for ransom, created a storm in the political circle as well as medical fraternity with BJP claiming return of "jungle raj" in Bihar.
The Indian Medical Association (IMA) had also threatened to launch a stir if the state government failed to rescue the couple from the clutches of their abductors.
Kumar had also met the doctor couple's relatives at Gaya during his visit there two days ago.