Report setup_all errors and mark tests as invalid

Closes #878
Merge pull request #1030 from ericmj/report-setup-all-error

Report setup_all errors and mark tests as invalid