GitHub repository: tonywangcn/distributed-web-crawler
Primary language: Go
Description: The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler