t1gor/Robots.txt-Parser-Class — pull request #9 by sanchezby (2014-09-04 07:34:43+00:00)
Title: tail-$ processing fix

from https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt

$ designates the end of the URL