Assertion: search engine's website | /r/HasProperty | specified in the robots.txt
Facets:
Source sentences:
text: The crawler then crawls the areas of the website specified in the robots.txt.