how to compitable with diffusers sdxl controlnet pipeline?

#2
by tanghengjian - opened

how to compitable with diffusers sdxl controlnet pipeline?
thank you!!!

i mean how to load this file like this format
[-rw-r--r-- 1 xxx 1274 Feb 21 03:19 config.json
-rw-r--r-- 1 xxx 5004438321 Aug 12 2023 diffusion_pytorch_model.bin]
(https://huggingface.co/lllyasviel/sd-controlnet-depth/tree/main)

Owner

I have uploaded the config.json for you

Is there a .bin versions as well?

@TTPlanet can you share the the code snippet to load this model through diffusers ControlNetPipeline?

I have uploaded the config.json for you

model = ControlNetModel.from_single_file(
    './TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors',
    config_file='./config.json',
)

"cond_stage_config" in original_config["model"]["params"]
KeyError: 'model'

@nived2
Rename TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors as diffusion_pytorch_model.fp16.safetensors and put it in a folder with the config file, then use:
model = ControlNetModel.from_pretrained(folder_name)

Owner

sorry, I did not uploade the config for v2, I will update

@nived2
Rename TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors as diffusion_pytorch_model.fp16.safetensors and put it in a folder with the config file, then use:
model = ControlNetModel.from_pretrained(folder_name)

Thanks a lot! It works for me.
But renaming TTPLANET_Controlnet_Tile_realistic_v2_fp16.safetensors as diffusion_pytorch_model.safetensors is right.

I still meet the error

TTPlanet/TTPLanet_SDXL_Controlnet_Tile_Realistic does not appear to have a file named diffusion_pytorch_model.bin.

Could you share the diffusers code of how to run this model? thx a lot.

Sign up or log in to comment