BUG: Fixed font size (set it on both x and y axis). #8765

Fix for https://github.com/pydata/pandas/issues/8765 
The font size was only set on x axis if vertical or the y axis if horizontal.