inpcb: Group port related fields into inpcbportinfo

Prepare for port token splitting.