ensure that retrying the test will retry the new definition if it has been redefined