Apply font settings to only 'text' part of units

Done this way avoids messing up vertical placement of superscripts
and also adds the font much more in the way it would be done 'by hand'.