spiderhunt (npm): Very straightforward web crawler. Uses EventEmitter. Based on Simplecrawler but using a distributed queue system.
Keywords: simple|crawler|spider|cache|queue|simplecrawler|eventemitter|spiderhunt|distributed|redis|rabbitmq|rabbit|scalable