LiuRuiLin commited on
Commit
9a550d7
1 Parent(s): 152f64c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -3
README.md CHANGED
@@ -1,3 +1,22 @@
1
- ---
2
- license: unknown
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: unknown
3
+ ---
4
+ ### Quantize config:
5
+ ```json
6
+ {
7
+ "bits": 4,
8
+ "group_size": 128,
9
+ "damp_percent": 0.005,
10
+ "desc_act": false,
11
+ "static_groups": false,
12
+ "sym": false,
13
+ "true_sequential": true,
14
+ "model_name_or_path": "",
15
+ "model_file_base_name": "model",
16
+ "quant_method": "gptq",
17
+ "checkpoint_format": "gptq",
18
+ "meta": {
19
+ "quantizer": "autogptq:0.8.0.dev1"
20
+ }
21
+ }
22
+ ```