torchshard (pypi): Torchshard: Slicing a PyTorch Tensor Into Parallel Shards.
Keywords: model-parallel|pytorch|shard-training