Fix USE_FONTCONFIG=True mode

A simple bugfix for a problem found when switching on USE_FONTCONFIG.  Reported by Paulo César Pereira de Andrade on matplotlib-devel