Keep track of connections on sockets/servers.