cgiffard/node-simplecrawler — pull request #73 by leeroybrun (2014-04-29 15:15:20+00:00)
Title: Add maxDepth parameter #65

- SimpleCrawler now support defining a max depth for links to fetch.
- CSS/JS files are not affected by depth. This way all images and linked CSS/JS files from allowed HTML pages are fetched. If the HTML page depth is greater than max depth, we will not fetch it and not discover resources on it.