GitHub repository: second-state/LlamaEdge
Primary language: Rust
Description: The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge