The off-spinner, who was part of the playing eleven at Wankhede Stadium, said one should not forget Dhoni's contribution in making India the world champions.
"Winning and losing is a part of the game and players and captain like Dhoni, should not be criticised for just losing a single game," Harbhajan said.
"We should not forget that Dhoni is the same captain who won us the first World Cup after 1983 triumph. He is one of the best rated captains in the country. By losing just a single match, one should not raise questions at his ability," the tweaker, who like his other spin mates was put to test by the English side in Mumbai, added.
The 31-year-old deposed faith in his team and said the side will bounce back in the forthcoming Test at the Eden Gardens in Kolkata.
"People should not forget that we have beaten England in their home on many occasions. They should not criticise players and captain like this. We will perform better at Kolkata and will win there," he said.
Asked about Sachin Tendulkar's poor run with the bat, Harbhajan, who was here along with teammate Suresh Raina, said: "Sachin has priceless contribution, not only to Indian cricket, but to the world cricket. If he fails in one or two matches we should not criticise him.
"My wish is that he should keep playing for the country. His presence gives an edge to the team. Kolkata has always remained one of Sachin's favourite venues and I am hopeful that he will silence his critics with a brilliant knock there."