Make sure we set the pubkey when a private key is set.