grob is a robots.txt fetcher, cacher, parser, and rule checker.