web crawler that starts at a base URL and crawls all links while: 1. building sitemap.xml, 2. report broken links, 3. report server errors