phoenix-inst-chat-7b-int4 / quantize_config.json
GeneZC's picture
Upload 3 files
1f600a8
{
"bits": 4,
"damp_percent": 0.01,
"desc_act": true,
"group_size": 128
}