parameterised deduplication feature