Rework wire protocol to all use the serializer, fix RTT calculation