GitHub repository: paulpham157/paddler
Primary language: Rust
Description: Stateful load balancer custom-tailored for llama.cpp 🏓🦙