pygmalion-13b-4bit-128g-AutoGPTQ / quantize_config.json
usamakenway's picture
Upload folder using huggingface_hub
a4ddf36
{
"bits": 4,
"desc_act": false,
"group_size": 128
}