Clean up sockets on selector exit