abovzv

/

sdxl_segmentation_controlnet_ade20k

like 12

Hey @abovzv - I'd love to test your ade20k seg for sdxl, however it looks like the repo is missing config file when attempting:

controlnet = ControlNetModel.from_pretrained("abovzv/sdxl_segmentation_controlnet_ade20k", torch_dtype=torch.float16)
ControlNetModel.from_single_file did not work as well.
Just uploaded it, please check. By the way, I just used it in stable-diffusion-webui with single safetensor, and the result seems it works.

Thanks! I now get OSError: abovzv/sdxl_segmentation_controlnet_ade20k does not appear to have a file named diffusion_pytorch_model.bin.
For pure python usage, looks like that this folder structure and files are needed https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0/tree/main

Thanks! I now get OSError: abovzv/sdxl_segmentation_controlnet_ade20k does not appear to have a file named diffusion_pytorch_model.bin.
For pure python usage, looks like that this folder structure and files are needed https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0/tree/main

Well, I renamed the diffusion_pytorch_model.safetensors to sdxl_segmentation_controlnet_ade20k.safetensors, may be you can rename back.
Also , I will test this repo and make it work in this week. Now you can try it in sd-web-ui with just single file, which I have tested before.

I renamed the diffusion_pytorch_model.safetensors to sdxl_segmentation_controlnet_ade20k.safetensors, may be you can rename back.

Just did this locally and it works well. Excellent work on the model, seg classes react well without prompting. Good job!

I renamed the diffusion_pytorch_model.safetensors to sdxl_segmentation_controlnet_ade20k.safetensors, may be you can rename back.

Just did this locally and it works well. Excellent work on the model, seg classes react well without prompting. Good job!

Feel free to ask me if any problems here.