Having started off with a 6-1 humiliation of Honduras, Japan slumped to 1-2 defeat against France in their last outing.
"We need to win in order to go to the next round. Some of our players are eager and hungry to play on the pitch," Moriyama told reporters on the eve of their match.
"We started the tournament well but we had learnt some good lessons in our game against France. We will use those lessons in the next match," he added.
The coach further said he would like to take every match as a final in the knockout stage.
More From This Section
"Once we are in knock-out, we will treat every match like a final. We will go one game at a time thinking of that game as the final."
Japanese midfielder Naoki Tsubaki said they would like to get back their winning momentum in the match against New Caledonia.
If they qualify, Japan are likely to face England in the pre-quarterfinals.
"England are a strong team with strong individuals. But we believe in our strengths and we can play a good game. We are focused on our football," he said.