Do not htons the client port

It is not needed?

Change-Id: I301f788771ae20c90bd34de4b52cd62b6a3da863