We do not currently list matplotlib as a dependency (or even an optional dependency).  And I am in agreement with @paulromano that we need to curtail our existing dependency issues first.  All the matplotlib stuff and other views should get put into the gui/ dir (which I think @paulromano actually started ~_~).