Remove some duplicate keys