GitHub repository: vllm-project/llm-compressor
Primary language: Python
Created: 2024-06-20T20:13:35Z
Description: Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM