Assertion: web crawler | /r/CapableOf | follow certain policies
Facets:
value: to be more selective
type: PURPOSE
Source sentences:
text: Due to the vast number of webpages on the internet, the crawling process could go on almost indefinitely, which is why web crawlers follow certain policies to be more selective about the pages they crawl.