The incident took place in Pandav Nagar on January one when the victim had gone to the priest's house.
It came to light when the woman, who is in her early 30s, informed her husband about the incident. The couple then approached police.
A medical examination confirmed rape and priest M M Sharma, who was absconding since then, was arrested yesterday.
The priest had called the woman to his house on the pretext of preparing sweets to offer in temple.
After the incident, the accused also allegedly threatened her with dire consequences if she approached the police.