Avoid buffering the entire file list during walks
Handle needed files in batches