Report setup_all errors and mark tests as invalid

Closes #878