GitHub repository: polya20/nitro
Description: A fast, lightweight, embeddable inference engine to supercharge your apps with local AI.  OpenAI-compatible API