GitHub repository: BradHutchings/llama-server-one
Primary language: C++
Description: Cross platform inference server in a single executable.