Make the server struct include the net.IP