Listeners map to socket, not origin id, since multiple sockets may have the same origin