Implement a custom test runner, it does nothing yet, just putting it in place so we can start ignoring NotSupportedErrors somehow