Further, the mental image people have of an individual if you say the word "rapist" is almost exclusively male. Women can and in fact do rape men. It is tramuatizing for these men, but even amongst men it is something of a joke. Even men don't take the concept of a female raping a man seriously, and make jokes about how enjoyable it would be.
The problem isn't language, the problem is societal attitudes. In truth I don't think society has much respect for men or women.