GitHub repository: qwopqwop200/GPTQ-for-LLaMa
Primary language: Python
Description: 4 bits quantization of LLaMA using GPTQ