Take responsibility, take action and take risks. Change the situation as much as you possibly can. Be kind and thoughtful. Open your mind and heart to the possibility that this could be a personal, human problem between two people , that is compounded by gender. Work hard to understand the relationship and then take action to alter it.
Action is how to achieve resolution and change.
If working the problem yourself does not effect change, then take the risk of speaking up. Express your concerns to the man in a private conversation, in honest, but non-confrontational language. Tell him the work you have done to make things better, but that you are stuck with thinking the core issue remains that you are a woman. This requires great courage, especially if the man is in a position of power over you and your job. I sincerely believe that it is a risk worth taking, as the benefits from being forthright about problems and issues can be enormous.