The rifles, a .303 and a hand-made one, were packed inside a polythene bag and was covered with dry leaves in Kohora range of the park.
A ten-year-old boy spotted the bag and informed the local people who later informed the police.
The police and KNP guards have launched investigations and suspect that it was kept their by poachers who had recently killed an adult male rhino and taken away its horn in the same area.