Fix sign conversion bug.

Would have allowed super-large port numbers