Set destination port for client replies from relay.  Fixes #591