GitHub repository: ramanathanlab/distllm
Primary language: Python
Description: Distributed Inference for Large Language Models.