Refactor ft2font without CXX in module definition

All tests still pass on CPython. On PyPy, the following works
already:

import matplotlib
matplotlib.use('tkagg')
import matplotlib.pyplot as plt