Using InetSocketAddress to map servers, as we need to distinguish them by port as well