AshhLimaRP-Mistral-7B / AWQ /quant_config.json
lemonilia's picture
Upload 7 files
eb0a9cb
raw
history blame
90 Bytes
{
"zero_point": true,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM"
}