fixed dedup process