GitHub repository: nath1295/MLX-Textgen
Primary language: Python
Created: 2024-09-30T18:05:20Z
Description: A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.