URL errors This means that when Googlebot tried to crawl the URL, it was able to resolve your DNS, connect to your server, fetch and read your robots. txt file, and then request this URL, but something went wrong after that. We break the URL errors down into various categories based on what caused the error.