My suggestion when the feminist thing comes up is to not fall into that trap, I mean seriously. The whole goal is to make you try and defend feminism and completely sidetrack everything and try to make you seem to only care about women, and try and manipulate you into proving their point.
Every time I see someone bring up feminism and attack it, without fail, everyone starts trying to defend feminism.
They use this tactic because it's effective, it works, and people let them. Everything that's bad towards women, can be approached as equal rights, without feminism. Don't fall into defending feminism, just stick to equal rights, and human rights period, and stop trying to convince someone that feminism fits that. The fact that is has Fem in the word implies caring about ones groups rights over others, even if that's not the actual intent or truth. You can't win using that word, you just end up fighting about the term. Is a pointless waste of effort, and is only helping the other side. It's a trap with bait that is just too good.