GitHub repository: weni-ai/worker-runpod-vllm
Primary language: Python
Description: Tests for improving quantized LLM speedup using vLLM (among other technologies)