robotto (npm): A robots.txt reader, parser and matcher.
Keywords: robots|txt|reader|parser|matcher|crawler|spider|bot