The factory owner, Shyojiram Saini was arrested under Arms Act, the official said.
Besides parts of rifles, pistols and live cartridges, several equipments and machines were also recovered from the illegally run factory.
Police are now probing the links of the factory owner with his customers in other parts of the state.