Just add it to the environment that has matplotlib. The only issue is that installing Theano will add more overhead time, so it might lead to more timeouts. We really need to figure out how to install from binary.