Remove SideOnly in PacketPayload

SideOnly should only ever be a last resort.