Web Crawler Architecture.
High-performance web crawling