Remove connected clients when processing goodbye