Assertion: web crawler | /r/CapableOf | visit a web page
Facets:
value: by following links
type: MANNER
Source sentences:
text: When a search engine's web crawler visits a web page, it "reads" the visible text, the hyperlinks, and the content of the various tags used in the site, such as keyword rich meta tags.
text: A web crawler travels through the web by following links, just like you would have on any website.