More work on networking pipeline

Will need to fully document how the networking works, but this is a big
step. Just needs debugging on multiple machines to find out which step
is causing it to break.