I think it's important that it conveys an equivalent societal meaning. For example, if you label a girl a slut, society looks down on her. If you call a guy a slut, in many ways it's a badge of honour. So I guess if mistress has certain interpretations, the male equivalent needs the same. So how do people interpret "mistress"?