Ok, so let's remove this scipy requirement. Check the setup.py file too and make sure scipy is not there.

If only color strings work now, that is fine for the first release. Please remove any mention of matplotlib in the code if we are not using it (especially the travis tests and setup.py).