added deduping