YeungNLP commited on
Commit
5593fd8
1 Parent(s): 837c5aa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -1,11 +1,38 @@
 
1
  使用[Firefly](https://github.com/yangjianxin1/Firefly)项目微调baichuan-13b-base。训练数据约为一百万多轮对话数据,包括项目分享的moss数据+2万条school math数据。
2
 
 
 
 
 
3
  训练loss:
 
 
4
  ![firefly_logo](firefly-baichuan-13b-loss.jpg)
5
 
6
- 更多详情见项目:[Firefly](https://github.com/yangjianxin1/Firefly)
7
 
8
- 技术细节分享:[Firefly增强Baichuan-13B的多轮对话能力](https://mp.weixin.qq.com/s/djO8Tg3emmy6wzw_rTUlcw)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
  单轮对话:
11
  ```python
@@ -148,4 +175,4 @@ def main():
148
 
149
  if __name__ == '__main__':
150
  main()
151
- ```
 
1
+
2
  使用[Firefly](https://github.com/yangjianxin1/Firefly)项目微调baichuan-13b-base。训练数据约为一百万多轮对话数据,包括项目分享的moss数据+2万条school math数据。
3
 
4
+ 更多详情见项目:[Firefly](https://github.com/yangjianxin1/Firefly)
5
+
6
+ 技术细节分享:[Firefly增强Baichuan-13B的多轮对话能力](https://mp.weixin.qq.com/s/djO8Tg3emmy6wzw_rTUlcw)
7
+
8
  训练loss:
9
+
10
+ [//]: # (<img src="https://huggingface.co/YeungNLP/firefly-baichuan-13b/resolve/main/firefly-baichuan-13b-loss.jpg" width="450">)
11
  ![firefly_logo](firefly-baichuan-13b-loss.jpg)
12
 
 
13
 
14
+ C-Eval榜单:
15
+
16
+ | Model | C-Eval | STEM | Social Science | Humanities | Other |
17
+ |----------------------------------|--------|-------|----------------|------------|-------|
18
+ | Baichuan-13B-Chat(官方) | 52.05 | 42.23 | 65.27 | 58.61 | 51.32 |
19
+ | **firefly-baichuan-13b** | 51.36 | 44.24 | 61.65 | 54.63 | 51.68 |
20
+ | chatglm2-6b(官方) | 50.45 | 41.91 | 60.73 | 59.24 | 47.82 |
21
+ | **firefly-chatglm2-6b** | 49.13 | 43.6 | 58.83 | 54.48 | 45.03 |
22
+ | openbuddy-llama2-13b-v11.1-bf16 | 43.36 | 39.79 | 50.28 | 44.78 | 42.13 |
23
+ | chinese-alpaca-2-13b(哈工大) | 41.86 | 36.52 | 49.7 | 47.97 | 38.33 |
24
+ | openbuddy-llama2-13b-v8.1-fp16 | 41.62 | 38.82 | 44.66 | 40.28 | 45.32 |
25
+ | chinese-alpaca-2-7b(哈工大) | 41.48 | 35.01 | 50.08 | 43.02 | 43.87 |
26
+ | belle-llama2-13B-chat-0.4M | 41.11 | 40.04 | 44.71 | 42.09 | 38.82 |
27
+ | ziya-llama-13b | 39.1 | - | - | - | - |
28
+ | llama-2-13b-chat(官方) | 36.38 | 33.68 | 46.38 | 34.47 | 34.1 |
29
+ | lama-2-7b-chat(官方) | 35.86 | 32.85 | 40.04 | 37.37 | 36.01 |
30
+ | flagalpha/Llama2-Chinese-7b-Chat | 34.54 | 35.21 | 37.9 | 33.11 | 31.7 |
31
+ | yayi-13b-llama2 | 34.15 | 36.48 | 30.64 | 32.67 | 34.6 |
32
+ | yayi-7b-llama2 | 30.18 | 25.88 | 38.23 | 34.56 | 26.31 |
33
+ | linly-llama2-7b | 28.35 | 26.06 | 33.47 | 29.71 | 26.53 |
34
+ | linly-llama2-13b | 27.86 | 27.67 | 26.95 | 27.93 | 28.95 |
35
+
36
 
37
  单轮对话:
38
  ```python
 
175
 
176
  if __name__ == '__main__':
177
  main()
178
+ ```