get nan when inference with fp16

#6
by afwww - opened

get nan when inference with fp16

if your device supports it, bf16 should just work.

if not, you could try using this version https://huggingface.co/madebyollin/sdxl-vae-fp16-fix, which I attempted to make fp16-compatible

EDIT:
sdxl-vae-fp16-fix was built on top of the SDXL-VAE (0.9) checkpoint. SDXL-VAE (1.0) changed the decoder slightly:

image.png

I think the SDXL-VAE (0.9) decoder is substantially more stylish, so:

  • sdxl-vae-fp16-fix will continue to be compatible with both SDXL 0.9 and SDXL 1.0, but
  • sdxl-vae-fp16-fix outputs will continue to match SDXL-VAE (0.9), not SDXL-VAE (1.0)

image.png

This comment has been hidden
This comment has been hidden

@madebyollin Seems like they rolled back to the old version because of that color bleeding which is visible on the 1.0 version. So your version is still up-to-date. Thx for clarification.

Sign up or log in to comment