Crawler configuration