Optimum documentation

Single-HPU Training

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Single-HPU Training

Training on a single device is as simple as in Transformers:

  • You need to replace the Transformers’ Trainer class by the GaudiTrainer class,
  • You need to replace the Transformers’ TrainingArguments class by the GaudiTrainingArguments class and add the following arguments:
    • use_habana to execute your script on a HPU,
    • use_lazy_mode to use lazy mode or not (i.e. eager mode),
    • gaudi_config_name to give the name of (Hub) or the path to (local) your Gaudi configuration file.

You can find several examples in the official repository for the following tasks: