The two siblings Neha and Vishal Yadav, aged between 3 and 5, were in their house in Liluah when the cylinder exploded in the kitchen during cooking.
A relative, Ghanshyam Yadav, also died in hospital after sustaining severe burn injuries, police said.