crawley (npm): A simple web crawler
Keywords: crawler|crawling|scraping|scraper|web|depth|es6|javascript|node|nodejs|nodejs-web-crawler|npm|npm-module|npm-package|robots-txt|sitemap|yarn