Edentns
/

DataVortexS-10.7B-dpo-v1.5

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

JeongwonChoi commited on Jan 28

Commit

43df771

•

1 Parent(s): 1d8666c

Update README.md

Files changed (1) hide show

README.md +7 -9

README.md CHANGED Viewed

@@ -48,15 +48,13 @@ text = """\
 ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
-On Benchmarking ...
-| Task             |  0-shot |  5-shot | 10-shot | 50-shot |
-| :--------------- | ------: | ------: | ------: | ------: |
-| kobest_boolq     |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_copa      |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_hellaswag |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_sentineg  |     0.0 |     0.0 |     0.0 |     0.0 |
-| **Average**      | **0.0** | **0.0** | **0.0** | **0.0** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**

 ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
+| Task             |       0-shot |       5-shot |      10-shot |      50-shot |
+| :--------------- | -----------: | -----------: | -----------: | -----------: |
+| kobest_boolq     |      0.34687 |     0.930158 |     0.943013 |     0.938029 |
+| kobest_copa      |     0.693351 |     0.751805 |      0.75772 |     0.771704 |
+| kobest_hellaswag |     0.480736 |     0.470852 |     0.474766 |     0.478576 |
+| kobest_sentineg  |     0.789423 |     0.962208 |     0.967241 |     0.964717 |
+| **Average**      | **0.577595** | **0.778756** | **0.785685** | **0.788257** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**