Enabling failonerrors to be run from a deployed environment