GitHub repository: Chr1st1anSears/llm-compressor
Primary language: Python
Description: Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM