Cache remote address in handshake since it might be lost later.
Merge pull request #270 from rase-/cache-ip-in-handshake

Cache remote address in handshake since it might be lost later.