GitHub repository: matthew-mcateer/worker-runpod-vllm
Primary language: Python
Created: 2023-10-03T23:14:35Z
Description: Tests for improving quantized LLM speedup using vLLM (among other technologies)