Font manager cleanup

This cleans up some font manager related stuff.  We only ever loaded fonts that had the unicode='true' set, so all the code to determine whether we had the attribute set was a waste of time.