GitHub repository: sniperyen/crawlab
Primary language: Go
Description: Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架