Correctly report test setup errors and dont run tests
Add a test to ensure setup_all doesn't choke on errors