The 'kachha' house of the family was washed away in the cloudburst that occurred at a hilltop in Bandrali village, Naresh Chauhan, president of Naren Panchayat said.
"The bodies of all five deceased have been recovered with the help of the local people and one 12-year-old physically challenged boy survived," Shimla deputy Commissioner, Rohan Chand Thakur said.
The deceased include Lachhi Ram, his wife and three of his children.
The cloudburst damaged roads leading to Gawaldi village under Naren Panchayat in Rampur area, about 150 km away from Shimla. Apple orchards of some farmers were also washed away or damaged.
The SDM Nishant Thakur and the DSP rushed to the spot. The bodies of the victims have been sent for post-mortem.