Fixing a bug in robotsParser