The two boys had been missing since yesterday since they went to play near the water body in Nagabandha area.
Local people found the bodies floating in the water today and informed the police.
The boys, Noor Alam (five) and Mainul Haque (six) - were suspected to slipped into the water while playing, the sources said.