deduplication perfected