new removal of duplicates