Commit
•
b035dcd
1
Parent(s):
febead8
Upload quant_config.json with huggingface_hub
Browse files- quant_config.json +1 -0
quant_config.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"zero_point": true, "q_group_size": 128, "w_bit": 4, "version": "GEMM"}
|