How can feminists say that this is a mans world and that women are at a disadvantage?

If the "common man" casually tosses as many insults at all women everywhere as you do, then that's a case in point for the relevance of feminism right there.