The mishap occurred when the family was going to Tiruvannamalai from their hometown Tirupatthur.
Police said the accident took place early this morning after the driver dozed off and the vehicle rammed into the tree on the opposite side of the road.
The driver, who was seriously injured, has been hospitalised.