Assertion: search crawler | /r/CapableOf | look for a robots.txt file
Facets:
value: after arriving at a website
type: TEMPORAL
value: before spidering it
type: TEMPORAL
Source sentences:
text: After arriving at a website but before spidering it, the search crawler will look for a robots.txt file.