Ja, if you want to tell it to expect an error give it the relevant extra kwarg like [here](https://github.com/pypa/pip/blob/develop/tests/functional/test_install_wheel.py#L30)