Sorta...realized it messes up the test pass validation logic. I'm going to merge this and gate it on an env variable in next pull request.