The 83-year-old was only being taken for a check-up, a senior officer of the Rapid Action Battalion (RAB) said.
Witnesses said a joint team of police and elite RAB entered the private "President's Park" residence and virtually whisked to a car, fuelling speculation that Ershad was arrested.
Party activists scuffled with security personnel who took Ershad straight to the Combined Military Hospital (CMH) where he was admitted.
RAB media wing director Habibur Rahman said the RAB men deployed at his residence took him to the CMH as he "felt sick".
Also Read
TV footages showed a grim-faced Ershad was sitting on the backseat of a car wearing a red sweater as the convoy of police and RAB vans drove off.
"It is mysterious, I was with him (Ershad) until the evening...He was in good health and also took part in his routine physical exercise," Ershad's press secretary Sunil Subho Roy told newsmen.
His "hospitalization" at the secured facility came amid a desperate effort by Awami League to get the Jatiya Party, wracked with infighting and factional clashes, back to polls if required under the leadership of his wife Raushan Ershad, currently a minister in the polls time cabinet.