Remove duplication in runner test
Add test for and change error handling in Runner