Nissim Yeshaya was presiding over a hearing on the rape of a 13-year-old Israeli girl by four Palestinian youths when he made the comment. He apologised and said the remark was taken out of context.
Prime Minister Benjamin Netanyahu was among officials who harshly criticised the judge. He also withdrew his support for Yeshaya's appointment as head of his Likud Party's internal court. Several lawmakers called for the judge's immediate dismissal.
In a joint announcement today, Israel's justice minister and the president of the Supreme Court said Yeshaya addressed a hearing, where he expressed his desire to leave his post.