Michael Kirby, a veteran Australian high court judge, said the treatment of women returned to North Korea after already being abused in China had been particularly tough.
The UN Human Rights Council commission of inquiry has heard evidence in London, Tokyo and Seoul and will be in Washington from today.
The inquiry has heard harrowing stories of labour camps in the isolated state ruled by Kim Jong-Un as well from relatives of Japanese believed abducted by North Korean agents and families divided since the 1950-53 Korean War.
"I am a judge of 35 years experience and I have seen in that time a lot of melancholy court cases which somewhat harden one's heart.
Also Read
"But even in my own case, there have been a number of the testimonies which have moved me to tears and I am not ashamed to say that.
"You would have be a stony-hearted person not to be moved by the stories that the commission of inquiry has received," he declared.
The inquiry leader said women "figure very greatly in testimony" and make up the majority of the North Koreans who have tried to flee the tightly controlled state.
"Many of them have left and gone on to China where they are subject to forced marriages, trafficking and other human rights burdens," he added.
But China sends back many who are caught and those women "have suffered very grievously," Kirby said.
At a public hearing in London last week, Kim Song-Ju told of his four attempts to flee North Korea because of a famine that killed hundreds of thousands of North Koreans during the 1990s.
After crossing the icy Tumen river that marks the border with China in March 2006, Kim was caught by Chinese guards and forced back to North Korea.
He described beatings in a North Korean detention camp and how he was ordered to search prisoners' excrement for money they were believed to have swallowed.
He escaped to China on his fourth attempt and went to Britain with the help of missionaries.
North Korea has condemned the UN inquiry as "hostile" and said the witnesses are liars.