ist-daslab/gptq: Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
Category: llm
Language: Python
Homepage: https://arxiv.org/abs/2210.17323