Assertion: web crawler | /r/CapableOf | index the stuff
Facets:
Source sentences:
text: or you don't have a robots.txt sitting in your root directory with instructions not to follow certain directories, then web crawlers should be indexing the stuff.