Provide an aggregate test runner

Fix for #4583