GitHub repository: KolosalAI/kolosal-server
Primary language: C++
Description: Kolosal AI is an OpenSource and Lightweight alternative to Ollama to run LLMs 100% offline on your device.