Remove private key bindings and commands