74-year-old Rampal collapsed in the jail premises in the morning and was rushed to the district hospital where he was declared dead by the doctors, Jail Superintendent, Rajender Singh said.
A judicial inquiry has been ordered into the connection, Singh said.
Rampal was arrested in a rape case from Shorem village and was lodged in the jail since January 5, he added.