ChenWeiLi
/

Taiwan-inquiry_7B_v2.1

Text Generation

Doctor_consultation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ChenWeiLi commited on Apr 18

Commit

f7399ae

•

1 Parent(s): af1efab

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -38,6 +38,6 @@ The model got the **TMMLU+** (0 shot) performance using [EleutherAI/lm-evaluatio
 |Details on TMMLU+ (0 shot):<br/>Model                |       Base Model      |      STEM       | Social Science | Humanities | Other      |   AVG   |
 |-----------------------------------------------------|:---------------------:|:---------------:|:--------------:|:----------:|:----------:|:-------:|
-| Taiwan-inquiry_7B_v2.1                              |Breeze-7B-Instruct-v1_0| 36.46           | 43.94          | 35.68      | 38.21      | 39.38   |
 | Taiwan-inquiry_7B_v2.0                              |Breeze-7B-Instruct-v0_1| 36.17           | 43.59          | 35.45      | 37.63      | 38.95   |
 | Taiwan-inquiry_7B_v1.0                              |Taiwan-LLM-7B-v2.1-chat| 26.74           | 29.47          | 26.83      | 29.61      | 28.83   |

 |Details on TMMLU+ (0 shot):<br/>Model                |       Base Model      |      STEM       | Social Science | Humanities | Other      |   AVG   |
 |-----------------------------------------------------|:---------------------:|:---------------:|:--------------:|:----------:|:----------:|:-------:|
+| Taiwan-inquiry_7B_v2.1                              |Breeze-7B-Instruct-v1_0| 36.06           | 44.61          | 37.49      | 39.61      | 40.29   |
 | Taiwan-inquiry_7B_v2.0                              |Breeze-7B-Instruct-v0_1| 36.17           | 43.59          | 35.45      | 37.63      | 38.95   |
 | Taiwan-inquiry_7B_v1.0                              |Taiwan-LLM-7B-v2.1-chat| 26.74           | 29.47          | 26.83      | 29.61      | 28.83   |