Update README.md
Browse files
README.md
CHANGED
|
@@ -28,8 +28,18 @@ Jisoo Kim(kuotient)
|
|
| 28 |
#### **Base Model**
|
| 29 |
[state-spaces/mamba-2.8b-slimpj](https://huggingface.co/state-spaces/mamba-2.8b-slimpj)
|
| 30 |
## **Model Benchmark**
|
| 31 |
-
###
|
| 32 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
### Thanks
|
| 34 |
한국어 LLM 커뮤니티에 많은 기여와 동기부여를 해주고 계신 [maywell](https://huggingface.co/maywell)님 감사드립니다.
|
| 35 |
## Usage
|
|
|
|
| 28 |
#### **Base Model**
|
| 29 |
[state-spaces/mamba-2.8b-slimpj](https://huggingface.co/state-spaces/mamba-2.8b-slimpj)
|
| 30 |
## **Model Benchmark**
|
| 31 |
+
### KoBEST
|
| 32 |
+
| Model | boolq | copa | hellaswag | sentinag |
|
| 33 |
+
| --- | --- | --- | --- | --- |
|
| 34 |
+
| kuotient/mamba-ko-2.8b | 0.5825 | 0.6166 | 0.4051 | 0.3383 |
|
| 35 |
+
| state_spaces/mamba-2.8b-slimpj | 0.3343 | 0.4867 | 0.3452 | 0.3547 |
|
| 36 |
+
| kuotient/mamba-ko-2.8b-old (2B trained only) | 0.4236 | 0.5896 | 0.4012 | 0.4348 |
|
| 37 |
+
| kuotient/mamba-ko-2.8b-old-instruct | 0.4041 | 0.6505 | 0.4906 | 0.3348 |
|
| 38 |
+
| EleutherAI/polyglot-ko-1.3b | 0.3552 | 0.7196 | 0.5247 | 0.6790 |
|
| 39 |
+
| maywell/TinyWand-SFT | 0.3455 | 0.6142 | 0.3944 | N/A |
|
| 40 |
+
| microsoft/phi-2 | 0.3343 | 0.4792 | 0.3235 | N/A |
|
| 41 |
+
| TinyLlama/TinyLlama-1.1B | 0.3343 | 0.4784 | 0.3396 | N/A |
|
| 42 |
+
|
| 43 |
### Thanks
|
| 44 |
한국어 LLM 커뮤니티에 많은 기여와 동기부여를 해주고 계신 [maywell](https://huggingface.co/maywell)님 감사드립니다.
|
| 45 |
## Usage
|