got deduplication of entries working now