Keep a number of files in subfolders