Remove existing user key when replacing public key