[enh] speed up dedup and avoid spurious duplicate marks