Drop idea of setting the font directly

Revisions to the font system will mean that it's not really necessary
to have this 'fast' get out for setting the font command. Various other
changes are needed for this to fully make sense.