Sometimes people disagreeing have "privilege." And sometimes the people they are disagreeing with have just got it wrong. Regardless of the existence of sexism, nobody gets a free pass for all their claims or complaints just because of their gender. That would indeed be a "privilege."