added initial removial of duplicate files