remove duplicates add missing