JeongwonChoi commited on
Commit
43df771
1 Parent(s): 1d8666c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -9
README.md CHANGED
@@ -48,15 +48,13 @@ text = """\
48
 
49
  ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
50
 
51
- On Benchmarking ...
52
-
53
- | Task | 0-shot | 5-shot | 10-shot | 50-shot |
54
- | :--------------- | ------: | ------: | ------: | ------: |
55
- | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
56
- | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
57
- | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
58
- | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
59
- | **Average** | **0.0** | **0.0** | **0.0** | **0.0** |
60
 
61
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
62
 
 
48
 
49
  ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
50
 
51
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
52
+ | :--------------- | -----------: | -----------: | -----------: | -----------: |
53
+ | kobest_boolq | 0.34687 | 0.930158 | 0.943013 | 0.938029 |
54
+ | kobest_copa | 0.693351 | 0.751805 | 0.75772 | 0.771704 |
55
+ | kobest_hellaswag | 0.480736 | 0.470852 | 0.474766 | 0.478576 |
56
+ | kobest_sentineg | 0.789423 | 0.962208 | 0.967241 | 0.964717 |
57
+ | **Average** | **0.577595** | **0.778756** | **0.785685** | **0.788257** |
 
 
58
 
59
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
60