Assertion: web crawler | /r/CapableOf | use sitemap
Facets:
Source sentences:
text: Using sitemaps and databases of links discovered during previous crawls, web crawlers decide which URLs to visit next.
text: Using sitemaps and databases of links discovered during previous crawls, web crawlers decide which URLs to visit next.