Crawl a site to check for errors and broken links