update readme
Browse files
README.md
CHANGED
|
@@ -7,19 +7,16 @@ license: "apache-2.0"
|
|
| 7 |
## Chinese MRC roberta_wwm_ext_large
|
| 8 |
|
| 9 |
* 使用大量中文MRC数据训练的roberta_wwm_ext_large模型，详情可查看：https://github.com/basketballandlearn/MRC_Competition_Dureader
|
| 10 |
-
*
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
-
```
|
| 13 |
-
基于此MRC模型，在dureader2021 dev/A榜 效果对比
|
| 14 |
-
+-----------------------------------------------+-----+
|
| 15 |
-
| | F1 |
|
| 16 |
-
+-----------------------------------------------+-----+
|
| 17 |
-
| | dev | A榜 |
|
| 18 |
-
+-----------------------------------------------+-----+
|
| 19 |
-
| macbert-large (基于哈工大预训练语言模型) | 65.49 |64.27|
|
| 20 |
-
+-----------------------------------------------+-----+
|
| 21 |
-
| macbert-large (ours) | 70.45 |68.13|
|
| 22 |
-
+-----------------------------------------------+-----+
|
| 23 |
-
| roberta-wwm-ext-large (ours) | 68.91 |66.91|
|
| 24 |
-
+-----------------------------------------------+-----+
|
| 25 |
-
```
|
| 7 |
## Chinese MRC roberta_wwm_ext_large
|
| 8 |
|
| 9 |
* 使用大量中文MRC数据训练的roberta_wwm_ext_large模型，详情可查看：https://github.com/basketballandlearn/MRC_Competition_Dureader
|
| 10 |
+
* 此库发布的再训练模型，在 阅读理解/分类 等任务上均有大幅提高<br/>
|
| 11 |
+
（已有多位小伙伴在Dureader-2021等多个比赛中取得**top5**的成绩😁）
|
| 12 |
+
|
| 13 |
+
| 模型/数据集 | Dureader-2021 | tencentmedical |
|
| 14 |
+
| ------------------------------------------|--------------- | --------------- |
|
| 15 |
+
| | F1-score | Accuracy |
|
| 16 |
+
| | dev / A榜 | test-1 |
|
| 17 |
+
| macbert-large (哈工大预训练语言模型) | 65.49 / 64.27 | 82.5 |
|
| 18 |
+
| roberta-wwm-ext-large (哈工大预训练语言模型) | 65.49 / 64.27 | 82.5 |
|
| 19 |
+
| macbert-large (ours) | 70.45 / **68.13**| **83.4** |
|
| 20 |
+
| roberta-wwm-ext-large (ours) | 68.91 / 66.91 | 83.1 |
|
| 21 |
+
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|