auto enable TPU checkpoint save and checkpoint load using the proper wrappers
I trained a model on TPU with google colab. When trying to load the checkpoint on GPU it gives following error
RuntimeError: Could not run 'aten::empty.memory_format' with arguments from the 'XLATensorId' backend. 'aten::empty.memory_format' is only available for these backends: [CUDATensorId, SparseCPUTensorId, VariableTensorId, CPUTensorId, MkldnnCPUTensorId, SparseCUDATensorId].
How to load the checkpoint saved on TPU with cpu/gpu ?