Assertion: crawler | /r/CapableOf | want to find certain media types
Facets:
Source sentences:
text: To Restrict a Request: If a crawler only wants to find certain media types, it can make a HEAD request to ensure that all of the found resources will be the needed type.
text: If a crawler only wants to find certain media types, it can make a HEAD request to ensure that all of the found resources will be the needed type.