The country boat, with 22 people on board, toppled in the river drowning three unidentified children, while eight others went missing, the sources said.
The rest, including two boatmen, swam to safety.
The three bodies have been fished as efforts were on to recover the remaining bodies.
District Magistrate Manoj Kumar and Superintendent of Police (SP) Harpreet Kaur were camping at the site to supervise the relief and rescue works.
Disaster Management Minister Renu Kushwaha, who was passing through the area after the tragedy, had to face the brunt of the anger of local people who protested against non-arrival of the disaster team to assist relief works.