The man's wife and their two daughters as well as the balloon's pilot were hurt when the balloon fell about 50 metres (160 feet) in the western region of Fribourg, the police told AFP.
The balloon had taken off from Chateau d'Oex, in the Vaud region.