Fast deduplication gem based on the Duke engine