GitHub repository: ling0322/omni.rs
Primary language: C++
Description: Efficient inference of large language models.