hfl
/

chinese-mixtral-instruct-gguf

Mixture of Experts

Inference Endpoints

Model card Files Files and versions

hfl-rc commited on Jan 31

Commit

6fd9a25

•

1 Parent(s): 33685c6

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -27,6 +27,7 @@ Metric: PPL, lower is better
 | IQ2_XXS | 6.7233 +/- 0.06118 |
 | IQ2_XS | 7.4175 +/- 0.08420 |
 | Q2_K  | 4.5758 +/- 0.03959    |
 | Q3_K  | 4.5563 +/- 0.04126     |
 | Q4_0  | 3.9757 +/- 0.03455      |
 | Q4_K  | 3.9265 +/- 0.03407    |

 | IQ2_XXS | 6.7233 +/- 0.06118 |
 | IQ2_XS | 7.4175 +/- 0.08420 |
 | Q2_K  | 4.5758 +/- 0.03959    |
+| IQ3_XXS | - |
 | Q3_K  | 4.5563 +/- 0.04126     |
 | Q4_0  | 3.9757 +/- 0.03455      |
 | Q4_K  | 3.9265 +/- 0.03407    |