The "Duesseldorf cell", named after the western city where three of the men lived, had planned the attack but not yet decided on a target, the court found.
The ring leader, Moroccan national Abdeladim el-Kebir, 33, was sentenced to nine years in jail for planning the attack and being a member of a terrorist group.
Prosecutors said Kebir had received orders from a senior Al-Qaeda operative while at a weapons training camp on the Afghan-Pakistan border.
Police arrested three of the men in April 2011 in Duesseldorf and the fourth in December in the western city of Bochum after months of surveillance.
Also Read
Within weeks of the April arrests, US Navy Seals shot dead al-Qaeda leader Osama bin Laden in Pakistan and took away communications material, some of which further implicated the German group, media reports have said.
Prosecutors said the four men had been experimenting to build a bomb, which they hoped to detonate in a large crowd, to be followed by a second explosive device when emergency services arrived on the scene.
German Halil Simsek, 30, received a four and a half year prison term for supporting a terrorist group, at the end of the trial that lasted more than two years in Duesseldorf.