A distributed framework for information retrieval, processing and presentation of data
UbiCrawler: a scalable fully distributed Web crawler