Optimum documentation

Single-HPU Training

Join the Hugging Face community

to get started

# Single-HPU Training

Training on a single device is as simple as in Transformers:

• You need to replace the Transformers’ Trainer class by the GaudiTrainer class,
• You need to replace the Transformers’ TrainingArguments class by the GaudiTrainingArguments class and add the following arguments:
• use_habana to execute your script on a HPU,
• use_lazy_mode to use lazy mode or not (i.e. eager mode),
• gaudi_config_name to give the name of (Hub) or the path to (local) your Gaudi configuration file.

You can find several examples in the official repository for the following tasks: