maywell
/

Synatra-7B-Instruct-v0.2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

maywell commited on Oct 12, 2023

Commit

2fe83c2

•

1 Parent(s): 988bdf5

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -52,8 +52,8 @@ text = "<s>[INST] 아이작 뉴턴의 업적을 알려줘. [/INST]"
 | Model | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 | Avg
 | --- | --- | --- | --- | --- | --- | ---
-| kyujinpy/KoT-platypus2-13B(No.1 at 10-12) | **43.69** | **53.05** | **42.29** | **43.34** | **65.38** | **49.55**
-| Synatra-V0.1-7B-Instruct | **41.72** | **49.28** | **43.27** | **43.75** | **39.32** | **43.47**
 | **Synatra-7B-Instruct-v0.2** | **41.81** | **49.35** | **43.99** | **45.77** | **42.96** | **44.78**
 MMLU에서는 우세하나 Ko-CommonGen V2 에서 크게 약한 모습을 보임.

 | Model | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 | Avg
 | --- | --- | --- | --- | --- | --- | ---
+| kyujinpy/KoT-platypus2-13B(No.1 at 2023/10/12) | 43.69 | 53.05 | 42.29 | 43.34 | 65.38 | 49.55
+| Synatra-V0.1-7B-Instruct | 41.72 | 49.28 | 43.27 | 43.75 | 39.32 | 43.47
 | **Synatra-7B-Instruct-v0.2** | **41.81** | **49.35** | **43.99** | **45.77** | **42.96** | **44.78**
 MMLU에서는 우세하나 Ko-CommonGen V2 에서 크게 약한 모습을 보임.