GitHub repository: mcx/nitro
Primary language: C++
Description: A fast, lightweight, embeddable inference engine to supercharge your apps with local AI.  OpenAI-compatible API