I think you should still do SG_UNREF and SG_REF of the previous and new vector of children, respectively.