LiuRuiLin commited on
Commit
6c95a23
1 Parent(s): 883a6e5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -3
README.md CHANGED
@@ -1,3 +1,29 @@
1
- ---
2
- license: unknown
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: unknown
3
+ ---
4
+ ### Quantize config:
5
+ ```json
6
+ {
7
+ "bits": 4,
8
+ "group_size": 128,
9
+ "damp_percent": 0.01,
10
+ "desc_act": false,
11
+ "static_groups": false,
12
+ "sym": true,
13
+ "true_sequential": false,
14
+ "model_name_or_path": null,
15
+ "model_file_base_name": "model",
16
+ "quant_method": "gptq",
17
+ "checkpoint_format": "gptq",
18
+ "meta": {
19
+ "quantizer": "intel/auto-round:0.2.0.dev",
20
+ "packer": "autogptq:0.8.0.dev1",
21
+ "iters": 1000,
22
+ "lr": 0.001,
23
+ "minmax_lr": 0.001,
24
+ "enable_minmax_tuning": false,
25
+ "enable_quanted_input": true,
26
+ "scale_dtype": "float16"
27
+ }
28
+ }
29
+ ```