Almost all of the 54 sailors and fishermen that are still being held come from poor families in Asia, who say their pleas for help are falling on deaf ears.
Fifteen of the hostages are from the Malaysian-flagged container ship MV Albedo, which was captured in November 2010 and sank this month in rough seas, raising fears about the crew's fate.
"Now that the vessel has sunk, the owner has no interest to pay money and rescue the crew," families of some of the Albedo sailors wrote in a recent desperate appeal to the pirates.
The Albedo's crew was then shifted to the rusting hulk of the Omani-flagged but Taiwanese-owned fishing boat Naham 3, crammed into dark and harsh conditions below deck.
Also Read
The Naham was seized by pirates in March last year, with 28 of its crew held hostage on board.
But with the Naham also at risk of sinking -- and tethered dangerously to the wreck of the Albedo -- sources say many hostages have been moved onshore.
"We are very poor people, we even do not have any money to pay for medicines, school fees, buy food for our children."
Crew from at least two other vessels -- four from the FV Prantaly 12 and seven from the Asphalt Venture -- are also being held away from their boats.
Off Somalia's pirate coastline, there is some good news however: rates of attacks have tumbled in the past two years.
At their peak in January 2011, Somali pirates held 736 hostages and 32 boats, some onshore and others on their vessels.
"These are poor people from poor families," said John Steed, head of an internationally-backed liaison body, the Secretariat for Regional Maritime Security.