GitHub repository: EricLBuehler/candle-vllm
Primary language: Rust
Created: 2023-10-29T11:21:49Z
Description: Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.