Chinese-Pygmalion-13b-GPTQ / quantize_config.json
coyude's picture
Upload 8 files
3fa907e
{
"bits": 4,
"desc_act": false,
"group_size": 128,
"true_sequential": true
}