Added tests for _responseError method
Refactored and improved the logic for _responseError method
Added a re-crawl for 404 HEAD requests
Added a re-crawl for HPE_INVALID_CONTENT_LENGTH errors on HEAD requests