ENH Remove matplotlibwrap

This seems impossible to support correctly. If the user wants to use the
unreliable matplotlib method, they can do so directly. As it stands,
loading the same file returns different results for different
combinations of installed packages which is definitely disturbing