peanut gallery - (figurative) people whose criticisms are regarded as irrelevant or insignificant (resembling uneducated people who throw peanuts on the stage to express displeasure with a performance); "he ignored complaints from the peanut gallery"
So in general its a way of saying from those who opion means nothing.......IE Trolls, irish....etc...