@crawlify.io/robots (npm): Parses robots.txt files to provide meaningful, useful output as well as reporting syntax errors.
Keywords: robots.txt|parse|seo|meta|crawl|scraper|robots