Obey show_stderr when running a benchmark fails

This PR is based on #142