microsoft/deepspeed: DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Category: ml-dl
Language: Python
Topics: billion-parameters, compression, data-parallelism, deep-learning, gpu, inference, machine-learning, mixture-of-experts, model-parallelism, pipeline-parallelism, pytorch, trillion-parameters, zero
Homepage: https://www.deepspeed.ai/