Clients map should just be socketfd to client