DO NOT REVERT Rough start to new CrawlEngine design