Apply font resizing only when the current size doesn't match wanted size.