Revert "Add matplotlib requirement ..."

This reverts commit ea9c26e6e52b4aff5e8d5e1dabdfcd402e7c0533.

Won't cleanly install on readthedocs.org. :(