Process in batches to avoid decreasing efficiency