Add old response to History, akin to resolve_redirects