Move retries to TestRunner.