GitHub repository: EricLBuehler/mistral.rs
Primary language: Rust
Description: Blazingly fast LLM inference.