JeongwonChoi commited on
Commit
e02900b
1 Parent(s): dd069f5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -9
README.md CHANGED
@@ -50,15 +50,13 @@ text = """\
50
 
51
  ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
52
 
53
- On Benchmarking ...
54
-
55
- | Task | 0-shot | 5-shot | 10-shot | 50-shot |
56
- | :--------------- | ------: | ------: | ------: | ------: |
57
- | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
58
- | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
59
- | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
60
- | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
61
- | **Average** | **0.0** | **0.0** | **0.0** | **0.0** |
62
 
63
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
64
 
 
50
 
51
  ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
52
 
53
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
54
+ | :--------------- | -----------: | -----------: | -----------: | -----------: |
55
+ | kobest_boolq | 0.874261 | 0.897165 | 0.904985 | 0.907857 |
56
+ | kobest_copa | 0.807479 | 0.845701 | 0.860809 | 0.8719 |
57
+ | kobest_hellaswag | 0.504865 | 0.502074 | 0.50717 | 0.51609 |
58
+ | kobest_sentineg | 0.409404 | 0.967251 | 0.992443 | 0.982367 |
59
+ | **Average** | **0.649002** | **0.803048** | **0.816352** | **0.819553** |
 
 
60
 
61
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
62