Brown, one of the two new judges on the show, was loudly booed during the first day of taping itself, reported TMZ.
The 37-year-old judge told a popular brass band from New Orleans that she is not a fan of brass music.
Responding to her remark, the audience went nuts on her and started screaming 'Go home' and 'No respect'.
Upset over such behaviour, Brown leaned over to Howie Mandel, who comforted her.