GitHub repository: AutoGPTQ/AutoGPTQ
Primary language: Python
Description: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.