RobotsTxt.Checker (nuget): Small utility, used to check robots.txt on web app and make sure that it is valid. RobotsTxt check is based on https://www.nuget.org/packages/RobotsTxt, but this project is no longer maintained, so I copied it for myself and introduced some useful (as I see them) improvements
Keywords: utility|robots.txt|check