Here are some notes on the GCC test suite. I've prepared this in hopes that it might be a valuable data point in determining sc-test requirements. But it should give you a sense.
Successful compilation is considered a pass.
A source file is compiled and linked into an executable with the compiler. Successful linking is considered a pass. A source file is compiled and linked, and the resulting executable is invoked. The test is considered to have passed if the executable returns an exit code of zero. The test is considered to have passed if the compiler emits an expected set of diagnostic messages, but no additional diagnostic messages.