dcrawler (npm): DCrawler is a distribited web spider written in Nodejs and queued with Mongodb. It gives you the full power of jQuery to parse big pages as they are downloaded, asynchronously. Simplifying distributed crawler!
Keywords: distribited|crawling|spider|scraper|scraping|jquery|crawler