deepspeed (pypi): DeepSpeed library
Keywords: billion-parameters|compression|data-parallelism|deep-learning|gpu|inference|machine-learning|mixture-of-experts|model-parallelism|pipeline-parallelism|pytorch|trillion-parameters|zero