hfl
/

chinese-alpaca-2-1.3b-gguf

Inference Endpoints

Model card Files Files and versions Community

hfl-rc commited on Jan 22

Commit

66b940a

•

1 Parent(s): 026be4b

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -18,9 +18,12 @@ Metric: PPL, lower is better
 |-----|------|------|
 | Q2_K | 19.9339 +/- 0.29752 | 18.8935 +/- 0.28558 |
 | Q3_K | 17.2487 +/- 0.27668 | 17.2950 +/- 0.27994 |
 | Q4_K | 16.4583 +/- 0.26453 | 16.2688 +/- 0.26216 |
 | Q5_K | 15.7547 +/- 0.25207 | 16.0190 +/- 0.25782 |
 | Q6_K | 15.8166 +/- 0.25359 | 15.7357 +/- 0.25210 |
 *The model with `-im` suffix is generated with important matrix, which has generally better performance (not always though).*

 |-----|------|------|
 | Q2_K | 19.9339 +/- 0.29752 | 18.8935 +/- 0.28558 |
 | Q3_K | 17.2487 +/- 0.27668 | 17.2950 +/- 0.27994 |
+| Q4_0 | 16.1358 +/- 0.25091 | - |
 | Q4_K | 16.4583 +/- 0.26453 | 16.2688 +/- 0.26216 |
+| Q4_0 | 15.9068 +/- 0.25545 | - |
 | Q5_K | 15.7547 +/- 0.25207 | 16.0190 +/- 0.25782 |
 | Q6_K | 15.8166 +/- 0.25359 | 15.7357 +/- 0.25210 |
+| Q4_0 | 15.7972 +/- 0.25384 | - |
 *The model with `-im` suffix is generated with important matrix, which has generally better performance (not always though).*