GitHub repository: snowflakedb/ArcticInference
Primary language: Python
Description: ArcticInference: vLLM plugin for high-throughput, low-latency inference