It won't retry the last step. It'll still just run thenIfErrored just like a non-memory-exhaustion fatal error.

However, that step (add token, redirect) needs to allocate some memory itself, and so was failing if you had totally exhausted memory.