better exception recovery when disallowing redirects. Previously to that, some of the methods failed after not being able to retrieve the document