Updates to CrawlExecutor