AsirAsir commited on
Commit
ad32cb1
1 Parent(s): acd3f70

Upload 2 files

Browse files
Files changed (2) hide show
  1. README.md +6 -6
  2. README_zh.md +41 -0
README.md CHANGED
@@ -9,17 +9,17 @@ license_link: LICENSE
9
  </h1>
10
  </div>
11
 
12
- ## 模型介绍
13
 
14
- Index-1.9B-Character模型是由Index团队自主研发的大语言模型系列中的19亿参数规模的角色扮演模型,用户可以通过上传符合要求的角色对话语料实现few shots角色定制。
15
 
16
- 使用方式和相关代码详见[Index-1.9B/roleplay](https://github.com/bilibili/Index-1.9B/tree/main/roleplay)
17
 
18
- 更多细节详见我们的[GitHub](https://github.com/bilibili/Index-1.9B)[Index-1.9B技术报告](https://github.com/bilibili/Index-1.9B/blob/main/Index-1.9B%20%E6%8A%80%E6%9C%AF%E6%8A%A5%E5%91%8A.pdf)
19
 
20
- Index-1.9B-Character模型采用角色扮演领域的权威benchmark CharacterEval进行评估,该评测集从角色一致性、对话能力、角色扮演吸引力多个粒度进行评测,我们的1.9b模型整体均分排名第九,显著优于其他同量级模型。
21
 
22
- |模型|均分|角色一致性|对话能力|角色扮演吸引力|
23
  |:----:|:----:|:----:|:----:|:----:|
24
  |CharacterYuyan-RLHF|3.36|2.856|4.037|3.188|
25
  |CharacterYuyan|3.309|2.88|3.931|3.117|
 
9
  </h1>
10
  </div>
11
 
12
+ ## Model Introduction
13
 
14
+ The Index-1.9B-Character model is a role-playing model with 1.9 billion parameters in the large language model series independently developed by the Index team. Users can customize the few shots role by uploading the role dialogue materials that meet the requirements.
15
 
16
+ For usage and related codes, please see [Index-1.9B/roleplay](https://github.com/bilibili/Index-1.9B/tree/main/roleplay)
17
 
18
+ For more details, see our [GitHub](https://github.com/bilibili/Index-1.9B) and [Index-1.9B Technical Report](https://github.com/bilibili/Index-1.9B/blob/main/Index-1.9B%20%E6%8A%80%E6%9C%AF%E6%8A%A5%E5%91%8A.pdf)
19
 
20
+ The Index-1.9B-Character model is evaluated using the authoritative benchmark CharacterEval in the role-playing field. The evaluation set evaluates multiple granularities from the perspectives of character consistency, dialogue ability, and role-playing attractiveness. Our 1.9b model ranks ninth in overall average score, significantly better than other models of the same level.
21
 
22
+ |Model|Average score|character consistency|dialogue ability|role-playing attractiveness|
23
  |:----:|:----:|:----:|:----:|:----:|
24
  |CharacterYuyan-RLHF|3.36|2.856|4.037|3.188|
25
  |CharacterYuyan|3.309|2.88|3.931|3.117|
README_zh.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: license
4
+ license_link: LICENSE
5
+ ---
6
+ <div align="center">
7
+ <h1>
8
+ Index-1.9B
9
+ </h1>
10
+ </div>
11
+
12
+ ## 模型介绍
13
+
14
+ Index-1.9B-Character模型是由Index团队自主研发的大语言模型系列中的19亿参数规模的角色扮演模型,用户可以通过上传符合要求的角色对话语料实现few shots角色定制。
15
+
16
+ 使用方式和相关代码详见[Index-1.9B/roleplay](https://github.com/bilibili/Index-1.9B/tree/main/roleplay)
17
+
18
+ 更多细节详见我们的[GitHub](https://github.com/bilibili/Index-1.9B)和[Index-1.9B技术报告](https://github.com/bilibili/Index-1.9B/blob/main/Index-1.9B%20%E6%8A%80%E6%9C%AF%E6%8A%A5%E5%91%8A.pdf)
19
+
20
+ Index-1.9B-Character模型采用角色扮演领域的权威benchmark CharacterEval进行评估,该评测集从角色一致性、对话能力、角色扮演吸引力多个粒度进行评测,我们的1.9b模型整体均分排名第九,显著优于其他同量级模型。
21
+
22
+ |模型|均分|角色一致性|对话能力|角色扮演吸引力|
23
+ |:----:|:----:|:----:|:----:|:----:|
24
+ |CharacterYuyan-RLHF|3.36|2.856|4.037|3.188|
25
+ |CharacterYuyan|3.309|2.88|3.931|3.117|
26
+ |BC-NPC-Turbo|3.169|2.764|3.798|2.946|
27
+ |MiniMax|3.135|2.718|3.784|2.902|
28
+ |Baichuan2-13B|3.129|2.701|3.795|2.89|
29
+ |InternLM-20B|3.124|2.715|3.745|2.911|
30
+ |Baichuan2-7B|3.11|2.7|3.757|2.874|
31
+ |**Index-1.9B-character**|3.109|2.676|3.789|2.862|
32
+ |InternLM-7B|3.034|2.62|3.698|2.784|
33
+ |XVERSE-13B|3.022|2.632|3.605|2.83|
34
+ |Qwen-14B|3.016|2.649|3.542|2.858|
35
+ |GPT-4|3.006|2.697|3.448|2.873|
36
+ |Xingchen|2.991|2.595|3.646|2.732|
37
+ |XVERSE-7B|2.963|2.564|3.554|2.772|
38
+ |CharacterGLM|2.937|2.493|3.623|2.695|
39
+ |ChatGLM3-6B|2.898|2.556|3.399|2.739|
40
+ |Qwen-7B|2.849|2.54|3.327|2.679|
41
+ |GPT-3.5|2.381|2.101|2.749|2.293|