Fix up some flaky behavior of the new improved update e2e test.

Is this going to leak into the user's environment? Probably don't want to leave this sitting there.