Remove Vertex's label Set after last edge removal.