Optimum documentation

Notebooks

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v1.23.3).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Notebooks

Inference

Notebook Description
How to run inference with the OpenVINO Explains how to export your model to OpenVINO and to run inference with OpenVINO Runtime on various tasks Open in Colab Open in AWS Studio

Quantization

Notebook Description
How to quantize a question answering model with OpenVINO NNCF Show how to apply post-training quantization on a question answering model using NNCF Open in Colab Open in AWS Studio
How to quantize Stable Diffusion model with OpenVINO NNCF Show how to apply post-training hybrid quantization on a Stable Diffusion model using NNCF Open in Colab Open in AWS Studio
< > Update on GitHub