Gather all used files for possible deletion