The non-standard "crawl-delay" robots.txt directive is not processed by Googlebot.