Persist private key passphrase if requested