A rifle and four cartridges were also recovered from his possession.
Shamsher Singh was arrested during routine checking near Langerwal village here, Investigating Officer Joginder Singh said.
Police said that he was facing murder charges and had been declared PO by a local court.
During investigations, Shamsher claimed that he had borrowed the rifle and cartridges last year from Harmeet Singh, a resident of Badhowal village.