Gandhi, who held a meeting in north Bengal earlier in the day, was to address a workers meet at the Shahid Minar grounds here at 5:00 pm, with a closed enclosure created.
The nor-wester bringing heavy rainfall and strong winds destroyed the makeshift structure and the sound system.
Gandhi arrived at the meeting ground nevertheless, waved and went near the barricade and shook hands with supporters waiting for a glimpse of him.
"We had initially demanded the Netaji Indoor stadium. If we had got it then such a situation would not have occurred," he said.