The magnitude 9.0 quake, which struck under the Pacific Ocean on March 11, 2011, and the tsunami it spawned left about 18,500 people dead or missing.
The massive flow of water overwhelmed cooling systems at the Fukushima Daiichi power plant, causing meltdowns in three of its six reactors in what was the worst nuclear disaster since Chernobyl in 1986.
The quake and tsunami caused widespread damage to homes while radiation spread over a wide area, with more than 450,000 people evacuating in the immediate aftermath.
Prime Minister Shinzo Abe and other participants at a national ceremony in Tokyo bowed their heads in silent prayer, as did many residents across the affected region, at 2:46 pm (0546 GMT) -- the exact moment the quake struck.
More From This Section
The disaster "brought unprecedented damage" and "claimed many precious lives", Abe, dressed in formal mourning attire, told the solemn gathering.
"I possess unceasing sympathy for those who lost beloved family members and friends."
Japan's ageing Emperor Akihito and Empress Michiko did not attend this year's ceremony, but were represented by their son Prince Akishino and his wife Princess Kiko.
"Especially for those in prolonged evacuations, I feel pain deep in my heart thinking about the health of those ageing year by year in the disaster zone and people who remain unable to return home due to high radiation levels."
Separately, hundreds of police and firefighters combed beaches along the coast of Fukushima prefecture, as they do on the 11th of each month, in a search for remains or other evidence of people who remain unaccounted for.
The latest National Police Agency figures show that the total of dead or missing from the earthquake and tsunami stood at 18,446 people.
While no deaths have been attributed to radiation exposure, evacuees are concerned the government is moving too fast to deem once closed off areas safe to inhabit.