Assertion: web crawler | /r/HasAspect | limit
Facets:
value: to
type: OTHER
Source sentences:
text: Intuitively, the reasoning is that, as web crawlers have a limit to how many pages they can crawl in a given time frame, (1) they will allocate too many new crawls to rapidly changing pages at the expense of less frequently updating pages, and (2) the freshness of rapidly changing pages lasts for shorter period than that of less frequently changing pages.