parse-robots (npm): Promise based parser for robots.txt files.
Keywords: crawl|web|robots.txt|seo|robotstxt|robots|robots-txt|sitemap