MediaTek-Research
/

Breeze-7B-Instruct-v0_1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

YC-Chen commited on Jan 11

Commit

47300a8

•

1 Parent(s): b2afa7e

Update README.md

Files changed (1) hide show

README.md +8 -5

README.md CHANGED Viewed

@@ -84,16 +84,19 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
 \* Taiwan-LLM models responds to multi-turn questions (English) in Traditional Chinese.
-| Category ACC of TMMLU+                              | STEM         | Social Science | Humanities | Other      |
 |-----------------------------------------------------|--------------|----------------|------------|------------|
 | Yi-6B-Chat                                    | 26.28        | 33.48          | 29.48      | 27.62      |
 | Breeze-7B-Instruct-v0.1           | 37.45        | 48.35          | 40.26      | 40.44      |
-| Taiwan-LLM-7B-v2.1-chat                  | 26.53        | 29.47          | 26.11      | 26.90      |
 | Qwen-7B-Chat                                   | 32.89        | 44.26          | 38.21      | 37.83      |
 | Taiwan-LLM-13B-v2.0-chat                 | 29.68        | 37.13          | 30.31      | 30.55      |
-| Qwen-14B-Chat                                  | 46.51        | 58.20          | 51.12      | 49.38      |
-| Yi-34B-Chat                                   | 46.36        | 65.02          | 52.84      | 52.21      |
-| gpt-3.5-turbo-1106                                  |              |                |            |            |
 ## Examples

 \* Taiwan-LLM models responds to multi-turn questions (English) in Traditional Chinese.
+| Category ACC of TMMLU+ (0 shot)                      | STEM         | Social Science | Humanities | Other      |
 |-----------------------------------------------------|--------------|----------------|------------|------------|
+| gpt-3.5-turbo-1106                                  |              |                |            |            |
+| Yi-34B-Chat                                   | 46.36        | 65.02          | 52.84      | 52.21      |
+| Qwen-14B-Chat                                  | 46.51        | 58.20          | 51.12      | 49.38      |
 | Yi-6B-Chat                                    | 26.28        | 33.48          | 29.48      | 27.62      |
 | Breeze-7B-Instruct-v0.1           | 37.45        | 48.35          | 40.26      | 40.44      |
+| Breeze-7B-Instruct-64k-v0.1           | 37.45        | 48.35          | 40.26      | 40.44      |
 | Qwen-7B-Chat                                   | 32.89        | 44.26          | 38.21      | 37.83      |
 | Taiwan-LLM-13B-v2.0-chat                 | 29.68        | 37.13          | 30.31      | 30.55      |
+| Taiwan-LLM-7B-v2.1-chat                  | 26.53        | 29.47          | 26.11      | 26.90      |
 ## Examples