Always bomb out if failures during backend startup

If we fail to start our backends correctly, the tests will
error in non-intuitive ways.

As a result, consider any failure in starting up the backends
as Fatal.
Reset state after Stop() test