deduplication is not trivial anymore.