You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v0.14.0).
How to use OpenVINO for inference
🤗 Optimum provides a Stable Diffusion pipeline compatible with OpenVINO. You can now easily perform inference with OpenVINO Runtime on a variety of Intel processors (see the full list of supported devices).
Install 🤗 Optimum Intel with the following command:
pip install optimum["openvino"]
Stable Diffusion Inference
To load an OpenVINO model and run inference with OpenVINO Runtime, you need to replace
OVStableDiffusionPipeline. In case you want to load a PyTorch model and convert it to the OpenVINO format on-the-fly, you can set
from optimum.intel.openvino import OVStableDiffusionPipeline model_id = "runwayml/stable-diffusion-v1-5" pipe = OVStableDiffusionPipeline.from_pretrained(model_id, export=True) prompt = "a photo of an astronaut riding a horse on mars" images = pipe(prompt).images
You can find more examples (such as static reshaping and model compilation) in optimum documentation.