GitHub repository: wangcx18/llm-vscode-inference-server
Primary language: Python
Created: 2023-09-25T00:51:22Z
Description: An endpoint server for efficiently serving quantized open-source LLMs for code.