PracticeLLM
/

Twice-KoSOLAR-16.1B-instruct-test

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

kyujinpy commited on Jan 1

Commit

5bef3fc

•

1 Parent(s): d0ebbc4

Upload README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -63,7 +63,7 @@ python finetune.py \
 - Follow up as [Ko-link](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
 | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Ko-CommonGenV2 |
 | --- | --- | --- | --- | --- | --- | --- |
-| PracticeLLM/Twice-KoSOLAR-16.1B-instruct-test | NaN | NaN | NaN | NaN | NaN | NaN |
 | PracticeLLM/Twice-KoSOLAR-16.1B-test | 50.20 | 45.65 | 57.14 | 51.39 | 42.99 | 53.84 |
 | [Megastudy/M-SOLAR-10.7B-v1.1-beta](https://huggingface.co/Megastudy/M-SOLAR-10.7B-v1.1-beta) | 55.25 | 51.71 | 60.86 | 54.24 | 47.12 | 62.34 |
 | [jjourney1125/M-SOLAR-10.7B-v1.0](https://huggingface.co/jjourney1125/M-SOLAR-10.7B-v1.0) | 55.15 | 49.57 | 60.12 | 54.60 | 49.23 | 62.22 |

 - Follow up as [Ko-link](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
 | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Ko-CommonGenV2 |
 | --- | --- | --- | --- | --- | --- | --- |
+| PracticeLLM/Twice-KoSOLAR-16.1B-instruct-test | 53.64 | 52.30 | 59.98 | 53.42 | 44.07 | 58.44 |
 | PracticeLLM/Twice-KoSOLAR-16.1B-test | 50.20 | 45.65 | 57.14 | 51.39 | 42.99 | 53.84 |
 | [Megastudy/M-SOLAR-10.7B-v1.1-beta](https://huggingface.co/Megastudy/M-SOLAR-10.7B-v1.1-beta) | 55.25 | 51.71 | 60.86 | 54.24 | 47.12 | 62.34 |
 | [jjourney1125/M-SOLAR-10.7B-v1.0](https://huggingface.co/jjourney1125/M-SOLAR-10.7B-v1.0) | 55.15 | 49.57 | 60.12 | 54.60 | 49.23 | 62.22 |