GitHub repository: 0cc4m/GPTQ-for-LLaMa
Primary language: Python
Description: 4 bits quantization of LLMs using GPTQ