Also set the font in the non-XFT case.