Starting monitoring before running test suite

runTheTests is blocking, so we need to start the test monitoring before
starting the actual runners.