Constable Sajad Ahmad was on guard duty at Khanqah e Moalla in Maharaj Gunj area of the city.
Besides his INSAS rifle, the militants, three to four in number, took away a magazine along with 20 rounds.
The police has launched a hunt for them, the official added.
Disclaimer: No Business Standard Journalist was involved in creation of this content