Design and implementation of a high-performance distributed Web crawler
Efficient Crawling Through URL Ordering