Chinese-Wizard-Vicuna-13B-GPTQ / quantize_config.json
coyude's picture
Upload 8 files
857d6c6
{
"bits": 4,
"desc_act": false,
"group_size": 128,
"true_sequential": true
}