GitHub repository: suluyana/GPTQModel
Primary language: Python
Description: Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.