runner: Exit with code 2 if any test failed

Suggested by Iain Lane for use in Ubuntu Jenkins runner.