Assertion: web crawler | /r/CapableOf | follow directive
Facets:
value: in a file
type: LOCATION
Source sentences:
text: Although respectable web crawlers follow the directives in a robots.txt file, each crawler might interpret the directives differently.
text: Although respectable web crawlers follow the directives in a file, each crawler might interpret the directives differently.