Optimum documentation

Installation

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v1.23.3).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Installation

To install Optimum for Intel® Gaudi® AI accelerator, you first need to install Intel Gaudi Software and the Intel Gaudi AI accelerator drivers by following the official installation guide. Then, Optimum for Intel Gaudi can be installed using pip as follows:

python -m pip install --upgrade-strategy eager optimum[habana]

To use Microsoft® DeepSpeed with Intel Gaudi devices, you also need to run the following command:

python -m pip install git+https://github.com/HabanaAI/DeepSpeed.git@1.18.0

To ensure that you are installing the correct Intel Gaudi Software, please run the hl-smi command to confirm the software version being used in the system and apply the same version when running the DeepSpeed installation; please review the Intel Gaudi Support Matrix and ensure that you are using an appropriate version of DeepSpeed.

< > Update on GitHub