Seems like maybe the pending reads should be a map from InetAddress to queue as well...