Only refresh id_cache if the parent field is active.