Hanumantappa Kyapannavar, in his late forties, was found chained by his sister Durgavva when police visited their house at Belur village following a tip off.
The man's hair was unkempt and had covered himself with just a long piece of cloth, Haveri SP Chetan Singh Rathore told PTI.
He, however, said it was difficult to say Hanumantappa was illegally confined, but initial investigations suggest that the victim was "restricted" from going out of the house.
This is the third such incident coming to light in Karnataka in the last four days.
On June 4, Bangalore police rescued a 35-year-old Hemavathi who was allegedly locked up in a room by her parents for about four years.
In another case, 90-year-old Ananth Kumar Shetty, who was allegedly kept chained on the terrace of his house here has been rescued this week.