The cache was seized yesterday when police went to arrest the jawan, Manoj Kumar, in a case of eve-teasing.
During search of the jawan's house, 20 cartridges of AK-47 rifle and a loaded pistol were found, Deputy SP A P Singh said.
Police are trying to trace the jawan who is currently at large.