hfl
/

chinese-alpaca-2-1.3b-gguf

Inference Endpoints

Model card Files Files and versions Community

hfl-rc commited on Jan 24, 2024

Commit

20ae77a

·

verified ·

1 Parent(s): 66b940a

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -23,7 +23,8 @@ Metric: PPL, lower is better
 | Q4_0 | 15.9068 +/- 0.25545 | - |
 | Q5_K | 15.7547 +/- 0.25207 | 16.0190 +/- 0.25782 |
 | Q6_K | 15.8166 +/- 0.25359 | 15.7357 +/- 0.25210 |
-| Q4_0 | 15.7972 +/- 0.25384 | - |
 *The model with `-im` suffix is generated with important matrix, which has generally better performance (not always though).*

 | Q4_0 | 15.9068 +/- 0.25545 | - |
 | Q5_K | 15.7547 +/- 0.25207 | 16.0190 +/- 0.25782 |
 | Q6_K | 15.8166 +/- 0.25359 | 15.7357 +/- 0.25210 |
+| Q8_0 | 15.7972 +/- 0.25384 | - |
+| F16 |  15.8098 +/- 0.25403 | - |
 *The model with `-im` suffix is generated with important matrix, which has generally better performance (not always though).*