Just to be clear, this isn't my idea. matplotlib devs told me to use that
approach for that reason.