Fix issue with test runner not reporting failures

Also fix exposed failures.

Fixes #1047
Fixes #1048