Web Crawlers: Taxonomy, Issues & Challenges
UbiCrawler: a scalable fully distributed Web crawler