A robots.txt parser (with caching support)