Check for a nil remote address since UDP connections won't have one.

Resolves #462.