GitHub repository: mcx/GPTQ-for-LLaMa
Primary language: Python
Description: 4 bits quantization of LLaMA using GPTQ