The mishap occurred near Sauni village when the jeep was on its way to Chandrapuri from the disaster-hit Agastyamuni area, police said.
They are feared to have been swept away in the swirling waters of the river, they said.
Search and rescue teams are scouring the river in search of the four passengers and the vehicle.