UbiCrawler: a scalable fully distributed Web crawler
High-performance web crawling