GitHub repository: malzag/paddler
Primary language: Go
Description: Stateful load balancer custom-tailored for llama.cpp