Don't compile runtime for each test run by default: only do it for All Tests