Optimized memory usage for SimpleCrawler