Optimum documentation

πŸ€— Optimum

You are viewing v1.18.1 version. A newer version v1.20.0 is available.
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

πŸ€— Optimum

πŸ€— Optimum is an extension of Transformers that provides a set of performance optimization tools to train and run models on targeted hardware with maximum efficiency.

The AI ecosystem evolves quickly, and more and more specialized hardware along with their own optimizations are emerging every day. As such, Optimum enables developers to efficiently use any of these platforms with the same ease inherent to Transformers.

πŸ€— Optimum is distributed as a collection of packages - check out the links below for an in-depth look at each one.

Hardware partners

The packages below enable you to get the best of the πŸ€— Hugging Face ecosystem on various types of devices.

Some packages provide hardware-agnostic features (e.g. INC interface in Optimum Intel).

Open-source integrations

πŸ€— Optimum also supports a variety of open-source frameworks to make model optimization very easy.