The alleged incident occured at around 11 am yesterday and the neighbour allegedly threatened to kill the woman if she made it public, Bankura superintendent of police Mukesh Kumar said.
The woman was alone at home at the time as her husband was away on work and her three children had gone to school.
A complaint was lodged at the local police station by her husband today, he said.
The man is absconding since the incident and search is on to catch him, the SP added.