Tweaking test runner so we can get reports from Jenkins