Refactored CrawlRunner