GitHub repository: veryci/neocrawler
Primary language: JavaScript
Description: Nodejs Crawler, including schedule, spider, web ui config, proxy modules. using nodejs, redis/ssdb, hbase, phantomjs. css selector extraction rules and regex extraction rules supported.