Optimum

Overview

Conceptual guides

Nvidia

AMD

Intel

AWS Trainium/Inferentia

Google TPUs

Habana

Furiosa

ONNX Runtime

Exporters

BetterTransformer

Torch FX

LLM quantization

Utilities

You are viewing v1.21.4 version. A newer version v1.23.3 is available.

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

🤗 Optimum Nvidia

Find more information about 🤗 Optimum Nvidia here.