Anita Devi, 30, and her two-year-old daughter Rita were sleeping in the house when the incident occurred late last night. The fire was triggered by a earthen lamp.
The two were rushed to a nearby hospital where they succumbed to injuries this morning, Superintendent of Police Manoj Kumar Jha said.
The bodies have been sent for post-mortem, the officer added.