Uday Bhan Singh was arrested from a house in Aalothok area of the district.
Two high explosive grenades, four country-made pistols of .315 bore, three .38 bore cartridges, eight cartridge carbines , five .303 bore cartridges, 18 cartridges of .315 bore, seven cartridge 7.32 bore were seized from Singh, police said.
Singh, whose real name was Shiv Dutt Singh, had illegally occupied a house and was living there as "tantrik".