Crawlers must have a clean method. It gets filthy crawling around everywhere.