Add TODO for controlling time warp in a better way
Let the ConnectionManager handle port-rewriting
Make sure we only do port-rewriting in flight