Transformers documentation

Training on TPUs

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v4.38.0).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Training on TPUs

Note: Most of the strategies introduced in the single GPU section (such as mixed precision training or gradient accumulation) and multi-GPU section are generic and apply to training models in general so make sure to have a look at it before diving into this section.

This document will be completed soon with information on how to train on TPUs.