Add cli test for step throwing exception. Unfortuately there's another bug now reporting extra test failures