Classic protocol and crypto cleanups.

```conn->conn_info->remote_key = key;``` a few lines back.