The incident took place in Birsinghpur village on Tuesday night when one of the labourers at the kiln went inside the main pit where bricks were being hardened to check them.
When he did not come out after being called, the other three also went inside to check on him, police said.
They all got choked to death from the smoke inside the pit, they said.
The deceased have been identified as Brajwasi (55), Gajraj (42), Dhani Ram (27) and Sintoo (24).