The ferry was heading to Paturia from Daulatdia in Rajbari when it was hit by a cargo trawler, a senior police official of Manikganj district said.
The site is 40 kilometres northwest from here.
The infant was rescued from the river but later declared dead at the hospital. At least two persons were feared missing.
Most of the passengers were rescued by nearby boats and a joint salvage operation by naval authorities in the Padma river in which the ferry sank.
More From This Section
On February 13, at least five persons, including a minor, were killed when an overloaded ferry carrying 200 passengers, mostly devotees, capsized in the Paira river.
Last month, rescuers recovered eight bodies from a fishing boat that capsized in the Bay of Bengal off the Bangladesh coast carrying migrants to Malaysia.
Last August, another ferry sank in a river in Bangladesh, killing about 130 people.