MediaTek-Research
/

Breeze-7B-Instruct-v0_1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

YC-Chen commited on Jan 10, 2024

Commit

5a8b07b

•

1 Parent(s): 6709dd2

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -43,7 +43,7 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
 \* Few-shot learning cannot effectively guide the model to generate the proper answer.
-| Category ACC of TMMLU+ Benchmark                    | STEM         | Social Science | Humanities | Other      |
 |-----------------------------------------------------|--------------|----------------|------------|------------|
 | 01-ai/Yi-6B                                         | 41.14        | 57.77          | 50.22      | 49.39      |
 | MediaTek-Research/Breeze-7B-Base-v0.1               | 35.74        | 46.08          | 40.29      | 39.27      |
@@ -85,7 +85,7 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
 \* Taiwan-LLM models responds to multi-turn questions (English) in Traditional Chinese.
-| Category ACC of TMMLU+ Benchmark                    | STEM         | Social Science | Humanities | Other      |
 |-----------------------------------------------------|--------------|----------------|------------|------------|
 | 01-ai/Yi-6B-Chat                                    | 26.28        | 33.48          | 29.48      | 27.62      |
 | MediaTek-Research/Breeze-7B-Instruct-v0.1           | 37.45        | 48.35          | 40.26      | 40.44      |

 \* Few-shot learning cannot effectively guide the model to generate the proper answer.
+| Category ACC of TMMLU+                              | STEM         | Social Science | Humanities | Other      |
 |-----------------------------------------------------|--------------|----------------|------------|------------|
 | 01-ai/Yi-6B                                         | 41.14        | 57.77          | 50.22      | 49.39      |
 | MediaTek-Research/Breeze-7B-Base-v0.1               | 35.74        | 46.08          | 40.29      | 39.27      |
 \* Taiwan-LLM models responds to multi-turn questions (English) in Traditional Chinese.
+| Category ACC of TMMLU+                              | STEM         | Social Science | Humanities | Other      |
 |-----------------------------------------------------|--------------|----------------|------------|------------|
 | 01-ai/Yi-6B-Chat                                    | 26.28        | 33.48          | 29.48      | 27.62      |
 | MediaTek-Research/Breeze-7B-Instruct-v0.1           | 37.45        | 48.35          | 40.26      | 40.44      |