Do not release payload if we shouldn't retry the request