GitHub repository: wejoncy/QLLM
Primary language: Python
Created: 2023-09-25T03:17:02Z
Description: A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.