simplecrawler-zic (npm): Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
Keywords: simple|crawler|spider|cache|queue|simplecrawler|eventemitter