Deutsches Museum spokesman Gerrit Faust told the dpa news agency on Tuesday that the 250-kilogram (550-pound) bomb was found near the entrance to the 90-year-old building.
Bomb disposal experts were able to successfully free the bomb, which still had an intact detonator, from the ground and planned to destroy it in a controlled detonation at a remote site.
Even 70 years after the end of the war, bombs are still regularly found during construction in major German cities like Munich and Berlin.