A web crawler that generates a sitemap for a given domain