GitHub repository: lectura7942/gpt-neox-llama
Primary language: Python
Description: An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.