The attackers ripped off the heads of the idols and threw them in the courtyard of the temple in Pirojpur district, Bdnews24 reported.
The idols were found smashed and destroyed this morning, a devotee was quoted as saying by the media.
A probe to find those responsible for the attack is already underway, said police official A Khalek.
"The attackers will be found and punished," Mrinal Kanti Dey, chief executive of Nazirpur sub-district, told Bdnews24.
The attack on the temple was the latest in a string of incidents against the Hindu minority.