Remove sockaddr struct from net_message