Fixed a bug with url parsing on the robotsParser