You are viewing main version, which requires installation from source. If you'd like
regular pip install, checkout the latest stable version (v4.47.1).
Training on TPUs
Note: Most of the strategies introduced in the single GPU section (such as mixed precision training or gradient accumulation) and multi-GPU section are generic and apply to training models in general so make sure to have a look at it before diving into this section.
This document will be completed soon with information on how to train on TPUs.