crawlmap (npm): A sitemapping tool for crawlers
Keywords: sitemap|crawler|robots.txt|webcrawler|parser