cloudyu
/

Mixtral_11Bx2_MoE_19B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

cloudyu commited on Jan 3

Commit

d00ebb5

•

1 Parent(s): 1b28e29

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -14,11 +14,11 @@ MoE  of the following models by powerful mergekit :
 * Local Test
-* hf (pretrained=cloudyu/Mixtral_11Bx2_MoE_19B,load_in_8bit=True), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 64
 |  Tasks  |Version|Filter|n-shot| Metric |Value |   |Stderr|
 |---------|-------|------|-----:|--------|-----:|---|-----:|
-|hellaswag|Yaml   |none  |     0|acc     |0.6911|±  |0.0046|
-|         |       |none  |     0|acc_norm|0.8647|±  |0.0034|
 gpu code example

 * Local Test
+* hf (pretrained=cloudyu/Mixtral_11Bx2_MoE_19B), gen_kwargs: (None), limit: None, num_fewshot: 10, batch_size: auto (32)
 |  Tasks  |Version|Filter|n-shot| Metric |Value |   |Stderr|
 |---------|-------|------|-----:|--------|-----:|---|-----:|
+|hellaswag|Yaml   |none  |    10|acc     |0.7142|±  |0.0045|
+|         |       |none  |    10|acc_norm|0.8819|±  |0.0032|
 gpu code example