Ishant reached the milestone in his 54th Test. After Zaheer Khan, the lanky speedster is currently India's most experienced fast bowler.
Ishant dismissed Rutherford for six in his first over of the innings after India won the toss and elected to bowl under overcast conditions.
Rutherford played away from his body at one outside the off-stump, got a thick edge and was caught by Ajinkya Rahane, who dived across to his right to take a superb catch at gully.
Taylor drove at a length ball but failed to keep it down. Ravindra Jadeja took a diving catch at wide mid-off to leave the visitors reeling at 34 for three.
Kumble leads India's wicket-takers with 619 in 132 tests and is third on the all-time list behind Sri Lanka's Muttiah Muralitharan (800) and Australia's Shane Warne (708).