If the node id is zero, remove the whole group