PyTorch/XLA GA support in pytorch-lightning
🚀 Feature
The PyTorch team just released native TPU support as GA for TPUs.
From the demos, it might be plug-and-play with the current pytorch-lightning implementation of xla, but more work may need to be done (since native support should result in a massive speedup), and documentation at minimum may need to be adjusted. (e.g. no more setup scripts in Colab!)