Issue #2217781 by alexpott: Can only run tests from the installed profile.