Update README.md
Browse files
README.md
CHANGED
|
@@ -52,30 +52,6 @@ LLaMA-Pro-Ko's performance is evaluated on two fronts: its proficiency in Englis
|
|
| 52 |
|
| 53 |
|
| 54 |
|
| 55 |
-
#### KoBEST
|
| 56 |
-
|
| 57 |
-
**5shot**
|
| 58 |
-
|
| 59 |
-
| | # tokens | copa | HellaSwag | boolq | sentiNeg | AVG |
|
| 60 |
-
| ------------------------------------------------------------ | :------: | :-----------: | :-----------: | ------------- | :-----------: | :----------: |
|
| 61 |
-
| [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 20B | 0.7626 | 0.4668 | 0.4657 | 0.8295 | 63.11 |
|
| 62 |
-
| [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 40B | **0.7927** | 0.4657 | **0.6977** | 0.7611 | 67.93 |
|
| 63 |
-
| [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b) | 15B | 0.7737 | **0.4831** | <u>0.6824</u> | **0.8991** | **70.96** |
|
| 64 |
-
| llama-pro-ko-8b | 10B | <u>0.7878</u> | <u>0.4748</u> | 0.6631 | <u>0.8752</u> | <u>70.02</u> |
|
| 65 |
-
|
| 66 |
-
**10shot**
|
| 67 |
-
|
| 68 |
-
| | # tokens | copa | HellaSwag | boolq | sentiNeg | AVG |
|
| 69 |
-
| ------------------------------------------------------------ | :------: | :------: | :-------: | :---------: | :---------: | ------------ |
|
| 70 |
-
| [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 20B | 0.78 | 0.47 | <u>0.68</u> | 0.87 | 70.12 |
|
| 71 |
-
| [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 40B | **0.80** | 0.47 | **0.71** | 0.73 | 67.81 |
|
| 72 |
-
| [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b) | 15B | 0.79 | **0.48** | 0.67 | <u>0.94</u> | **71.82** |
|
| 73 |
-
| llama-pro-ko-8b | 10B | **0.80** | **0.48** | 0.60 | **0.97** | <u>71.12</u> |
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|
| 79 |
### English Evaluation
|
| 80 |
|
| 81 |
#### Open LLM Benchmark
|
|
|
|
| 52 |
|
| 53 |
|
| 54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
### English Evaluation
|
| 56 |
|
| 57 |
#### Open LLM Benchmark
|