gollum (hex): Robots.txt parser with caching. Modelled after Kryten.
Keywords: crawler|elixir|robots-parser|robots-txt