t1gor/robots-txt-parser (packagist): PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
Keywords: parser|google|W3C|robots.txt|yandex|The Web Robots Pages|php|robots-txt|w3c