cleanup duplicates during gathering samples