Is not also up to women how they respond to any sexual harassment?
Your last comment gets to one of the areas that women have always had power, even if they do not either recognize it or admit it.
The women had more power over you than you care to admit.   What would have happened if one of those that made passes at you had done a 'Joseph' and cried rape?  Especially with the banter that was going on? 
Also, the union rep would have been a fool to accept any of those offers.  Again, any of those women could have accused him of rape.  
Talking about Joseph, did Potiphur's wife have power?  This is just one example of women having power.   As I have stated other ways that women exert power.