Remove declared matplotlib dependency in setup.

This is attempt to resolve failed builds in RTD.