High performance crawling system
Efficient Crawling Through URL Ordering