Police said the pastor was arrested after the two women lodged complaint against him on October 8.
The two women alleged that the accused used to rape and sexually exploit them on the pretext of driving out evil spirit from them.
The statement of the two victims were recorded under Section 164 of CrPC before a judicial magistrate in this regard, police said.
The pastor has been remanded to judicial custody for 14 days.