Zhang, who is currently Deputy Governor of the People's Bank of China (PBOC), would assume his duties on August 22.
He will succeed Min Zhu, who steps down on July 25.
Zhu is also a Chinese national.
"Mr Zhang brings a strong combination of international economic expertise, public sector policymaking, and diplomatic skills. He also has extensive experience with international financial institutions, excellent communication and negotiating skills, and a superb knowledge of IMF policies and procedures," Lagarde, the IMF Managing Director, said.
Prior to his current position as Deputy Governor of the PBOC, Zhang headed the Legal Affairs Department there.
Over the course of his career, he has held various positions at the PBOC, including as Director General of the Department of Financial Survey and Statistics, and then Director General of the International Department.