Don't keep recalculating sizeof(*server)

It's ridiculous that one has to go through these contortions with
sockaddr/sockaddr_in/sockaddr_in6 to support IPv6.
Move the inet_ntop shuffle into util.c