Refactor CrawlerProcessor