Added ability to filter duplicates