When both sides are mad at you, it's seldom because you are a model of fairness.
If both sides are unhappy with you, it's not usually because you're perfectly fair.