tensor-parallel (pypi): Automatically shard your large model between multiple GPUs, works without torch.distributed
Keywords: deep-learning|machine-learning|natural-language-processing|nlp|python|pytorch|pytorch-transformers