Taradevi (35), her children Sadhna (13), Rohit (12) and Akshya (10) were found dead near Milkichak village of the district, police said.
Police are suspecting that the woman, who had a fight with her husband last night, took the extreme step after killing the children.
Taradevi's alcoholic husband Harishchandra is a flower seller in the city and used to fight with her frequently, police said.
Last night they had a fight after which Harishchandra left the home and when he returned this morning his wife and children were missing.
A case has been registered and probe was on, police said.