Add check for "should not run" to error suite

Significant improvement to error suite output as well.