face_set_ptr can be unique rather than shared