For some reason the tests only succeed when called with python.