Infrastructure and packet handling

We still need client connection lookup, but this will do for now