Assertion: web search engine | /r/CapableOf | use web crawling
Facets:
Source sentences:
text: Web search engines and some other sites use Web crawling or spidering software to update their web content or indices of others sites' web content.
text: In contrast to general web search engines, which attempt to index large portions of the World Wide Web using a web crawler, vertical search engines typically use a focused crawler which attempts to index only relevant web pages to a pre-defined topic or set of topics.