Process CrawlerEntries in batches of List[CrawlerEntry]