OpenVINO

/

stable-diffusion-2-1-quantized

like 8

It is QAT and it is here but it is outdated: https://github.com/huggingface/optimum-intel/tree/main/examples/openvino/stable-diffusion.
Working on the PTQ now which should be much easier to use and provides better results.

You can find the default version that works for LCM diffusion model here as well: https://github.com/openvinotoolkit/openvino_notebooks/blob/main/notebooks/263-latent-consistency-models-image-generation/263-latent-consistency-models-image-generation.ipynb

@AlexKoff88 Thank you