Limit the maximum negative value of fontSizeAdjustment so the fonts don't get too small