RobotRules (nuget): A Simple and Powerful Library to Deal with Web Robots Control Strategy.
Keywords: Robots.txt|robot|crawler|web