Fix #503

Use some magic flow control to hide the exception from the subtest
codeblock when skip_all and bail_out are used.