duplicate removal functionality implemented. next steps is to show the list of duplicates.