Fix byte order of `PortNumber` encoding/decoding.