Assertion: web crawler | /r/Desires | permission
Facets:
value: usually
type: DEGREE
Source sentences:
text: Web crawlers don’t usually need permission to visit a page or use its resources, but mechanisms exist to notify them to steer clear of a certain part of a site or the whole of it.