Hm, something I found under mozfile:
https://github.com/mozilla/mozbase/blob/master/mozfile/setup.py#L23

Wouldn't that help us here so that we can get rid of the whole setup logic, and simply let the dev call ´python setup.py test´ once? Given that we got that code from mozbase we might want to use the same method?