Add method to CrawlJobContainerService to process url discovery task results