cgiffard/node-simplecrawler — pull request #77 by leeroybrun (2014-05-23 12:04:39+00:00)
Title: Add maxDepth parameter

- SimpleCrawler now support defining a max depth for links to fetch.
- CSS/JS files are not affected by depth. This way all images and linked CSS/JS files from allowed HTML pages are fetched. If the HTML page depth is greater than max depth, we will not fetch it and not discover resources on it.