GitHub repository: spider2048/WebCrawler
Primary language: JavaScript
Description: A fast, asynchronous web crawler, indexer and a search engine