The brothers were playing near the reservoir yesterday evening and accidentally fell into it, police said today.
The victims were identified as Bhupat Singh (6) and his 18-months-old brother Raju, they said.
Bodies were handed over to their father after postmortem, police added.