DeepFloyd

/

IF-I-XL-v1.0

like 591

Hi,
Thanks for offering the amazing model, while running it i got the following error:
```
A mixture of fp16 and non-fp16 filenames will be loaded.
Loaded fp16 filenames:
[text_encoder/model.fp16-00001-of-00002.safetensors, text_encoder/model.fp16-00002-of-00002.safetensors, unet/diffusion_pytorch_model.fp16.safetensors, safety_checker/model.fp16.safetensors]
Loaded non-fp16 filenames:
[watermarker/diffusion_pytorch_model.safetensors
If this behavior is not expected, please check your folder structure.
The config attributes {'encoder_hid_dim_type': 'text_proj'} were passed to UNet2DConditionModel, but are not expected and will be ignored. Please verify your config.json configuration file.
Loading checkpoint shards: 100%
2/2 [00:00<00:00, 3.03it/s]
The config attributes {'lambda_min_clipped': -5.1} were passed to DDPMScheduler, but are not expected and will be ignored. Please verify your scheduler_config.json configuration file.

ValueError Traceback (most recent call last)
in <cell line: 7>()
5 #https://www.zhangzhenhu.com/aigc/imagen.html
6 # stage 1
----> 7 stage_1 = DiffusionPipeline.from_pretrained("DeepFloyd/IF-I-XL-v1.0", variant="fp16", torch_dtype=torch.float16)
8 stage_1.enable_xformers_memory_efficient_attention() # remove line if torch.version >= 2.0.0
9 stage_1.enable_model_cpu_offload()

1 frames
/usr/local/lib/python3.10/dist-packages/diffusers/pipelines/pipeline_utils.py in load_sub_model(library_name, class_name, importable_classes, pipelines, is_pipeline_module, pipeline_class, torch_dtype, provider, sess_options, device_map, model_variants, name, from_flax, variant, low_cpu_mem_usage, cached_folder)
385 class_obj()
386
--> 387 raise ValueError(
388 f"The component {class_obj} of {pipeline_class} cannot be loaded as it does not seem to have"
389 f" any of the loading methods defined in {ALL_IMPORTABLE_CLASSES}."

ValueError: The component <class 'transformers.utils.dummy_sentencepiece_objects.T5Tokenizer'> of <class 'diffusers.pipelines.deepfloyd_if.pipeline_if.IFPipeline'> cannot be loaded as it does not seem to have any of the loading methods defined in {'ModelMixin': ['save_pretrained', 'from_pretrained'], 'SchedulerMixin': ['save_pretrained', 'from_pretrained'], 'DiffusionPipeline': ['save_pretrained', 'from_pretrained'], 'OnnxRuntimeModel': ['save_pretrained', 'from_pretrained'], 'PreTrainedTokenizer': ['save_pretrained', 'from_pretrained'], 'PreTrainedTokenizerFast': ['save_pretrained', 'from_pretrained'], 'PreTrainedModel': ['save_pretrained', 'from_pretrained'], 'FeatureExtractionMixin': ['save_pretrained', 'from_pretrained'], 'ProcessorMixin': ['save_pretrained', 'from_pretrained'], 'ImageProcessingMixin': ['save_pretrained', 'from_pretrained'], 'ORTModule': ['save_pretrained', 'from_pretrained']}.

I would really appreciate any assistance to resolve it.
Thanks,
Andy