Optimum

Overview

🤗 Optimum Installation Quick tour Notebooks

Conceptual guides

Quantization

Nvidia

AMD

Intel

AWS Trainium/Inferentia

Google TPUs

Habana

🤗 Optimum Habana Installation Quickstart

Tutorials

How-To Guides

Overview Pretraining Transformers Accelerating Training Accelerating Inference How to use DeepSpeed Multi-node Training

Conceptual Guides

Reference

Furiosa

ONNX Runtime

Exporters

BetterTransformer

Torch FX

LLM quantization

Utilities

You are viewing v1.20.0 version. A newer version v1.23.3 is available.

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Overview

Welcome to the Optimum for Intel Gaudi how-to guides! These guides tackle more advanced topics and will show you how to easily get the best from HPUs:

Pretraining models
Accelerating training
Accelerating inference
Using DeepSpeed to train larger models
Multi-node training for faster runs

< > Update on GitHub

←LDM3D Pretraining Transformers→