occiglot
/

occiglot-7b-eu5

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mbrack commited on Mar 7

Commit

7c9992b

•

1 Parent(s): fa93aba

Update README.md

Files changed (1) hide show

README.md +7 -7

README.md CHANGED Viewed

@@ -139,13 +139,13 @@ Currently, we are working on more suitable benchmarks for Spanish, French, Germa
 |                                      |   arc_challenge_it |   belebele_it |   hellaswag_it |   mmlu_it |   truthfulqa_it |      avg |
 |:-------------------------------------|-------------------:|--------------:|---------------:|----------:|----------------:|---------:|
-| occiglot/occiglot-7b-eu5             |           0.501283 |      0.652222 |       0.700533 |         0 |        0.252874 | 0.421382 |
-| occiglot/occiglot-7b-eu5-instruct    |           0.516681 |      0.661111 |       0.71326  |         0 |        0.295019 | 0.437214 |
-| occiglot/occiglot-7b-it-en           |           0.536356 |      0.684444 |       0.694768 |         0 |        0.247765 | 0.432667 |
-| occiglot/occiglot-7b-it-en-instruct  |           0.545766 |      0.717778 |       0.713804 |         0 |        0.303959 | 0.456261 |
-| galatolo/cerbero-7b                  |           0.522669 |      0.717778 |       0.631567 |         0 |        0.302682 | 0.434939 |
-| mistralai/Mistral-7B-v0.1            |           0.502139 |      0.734444 |       0.630371 |         0 |        0.264368 | 0.426264 |
-| mistralai/Mistral-7B-Instruct-v0.2   |           0.519247 |      0.703333 |       0.6394   |         0 |        0.349936 | 0.442383 |
 </details>

 |                                      |   arc_challenge_it |   belebele_it |   hellaswag_it |   mmlu_it |   truthfulqa_it |      avg |
 |:-------------------------------------|-------------------:|--------------:|---------------:|----------:|----------------:|---------:|
+| Occiglot-7b-eu5             |           0.501283 |      0.652222 |       0.700533 |         0 |        0.252874 | 0.421382 |
+| Occiglot-7b-eu5-instruct    |           0.516681 |      0.661111 |       0.71326  |         0 |        0.295019 | 0.437214 |
+| Occiglot-7b-it-en           |           0.536356 |      0.684444 |       0.694768 |         0 |        0.247765 | 0.432667 |
+| Occiglot-7b-it-en-instruct  |           0.545766 |      0.717778 |       0.713804 |         0 |        0.303959 | 0.456261 |
+| Cerbero-7b                  |           0.522669 |      0.717778 |       0.631567 |         0 |        0.302682 | 0.434939 |
+| Mistral-7B-v0.1            |           0.502139 |      0.734444 |       0.630371 |         0 |        0.264368 | 0.426264 |
+| Mistral-7B-Instruct-v0.2   |           0.519247 |      0.703333 |       0.6394   |         0 |        0.349936 | 0.442383 |
 </details>