The Okinotori atoll, also known as Douglas Reef, lies 1,700 kilometres (1,060 miles) south of Tokyo and is the southernmost point of Japan's territory.
It is disputed by China, which says that the islands are just a collection of rocks and should not be included in Japan's 200-nautical-mile exclusive economic zone.
The workers were reinforcing the islands' shore protection when the bridge fell down in the early hours yesterday, public broadcaster NHK reported.
A local coastguard official said 16 workers had been at the site and nine were confirmed safe, adding that no further details of how the accident occurred were immediately available.
The accident occurred at 7:30 am yesterday at the atoll which covers an area of around 11 kilometres (seven miles) and has been extensively eroded by waves.
Reinforced by concrete, at high tide only the tops of two rocks remain above the surface.