socket: Fix issue with hardware/network byte order

wb_remote will always be in hardware byte-order. Always convert to
network byte-order when dealing with sockets/addrs