GitHub repository: leopardslab/CrawlerX
Primary language: SCSS
Created: 2020-05-13T05:11:15Z
Description: CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way.