Transformers documentation

Training on TPUs

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Training on TPUs

Note: Most of the strategies introduced in the single GPU section (such as mixed precision training or gradient accumulation) and mutli-GPU section are generic and apply to training models in general so make sure to have a look at it before diving into this section.

This document will be completed soon with information on how to train on TPUs.