VecRelabeling conjugates the symmetry group of the underlying Vec, if already computed.