parsero (pypi): A Python based Robots.txt audit tool
Keywords: Robots.txt|Audit|Webserver