GitHub repository: lokalebasen/simply-robotstxt
Primary language: Ruby
Description: Parse a robots.txt file in ruby