Revert "Test cases can be run after failing a step"

This reverts commit 5a782571890dfa45a79738046cfb3c1b85a3d165.