Remove public key and authorized_hosts