Add flag to abort test run if suites don't compile #2