Only need to replace the associated object if the set is new