Wicketkeeper Haddin and Mitchell Johnson came to the rescue after Broad, loud boos ringing in his ears at Brisbane's Gabba ground, ripped through Australia's top order on day one.
The pair combined in a counter-punching 114-run stand for the seventh wicket before the outstanding Broad bowled Johnson (64) with the second new ball for his fifth wicket of the innings.
Just before stumps, Australia lost another wicket when Peter Siddle was caught in the slips for seven off James Anderson 14 balls.
It was Haddin's 13th Test half-century as runs came easily in the last session. Johnson racked up his eighth Test 50 with a booming boundary before Broad had the last word.
More From This Section
If not for Haddin and Johnson's fightback, Australia would have been in a parlous state after Broad had struck twice in the morning session and twice more after lunch to have the home side teetering at 132 for six.
The boos rang out when Broad, branded a "smug Pommy cheat" by a local newspaper, stepped up to bowl but he quickly snared opener Chris Rogers for one in his second over.
Broad also accounted for Shane Watson (22) just before lunch, and he then took the prized scalp of Australian skipper Clarke in the second over after the first break.