Update README.md
Browse files
README.md
CHANGED
@@ -28,9 +28,9 @@ ZEN2 model, which uses N-gram to enhance text semantic and has 668M parameters,
|
|
28 |
|
29 |
## 模型信息 Model Information
|
30 |
|
31 |
-
我们与[ZEN团队](https://github.com/sinovation/
|
32 |
|
33 |
-
We open source and publicly release ZEN2 using our Fengshen Framework in collaboration with the [ZEN team](https://github.com/sinovation/
|
34 |
|
35 |
### 下游效果 Performance
|
36 |
|
|
|
28 |
|
29 |
## 模型信息 Model Information
|
30 |
|
31 |
+
我们与[ZEN团队](https://github.com/sinovation/ZEN2)合作,使用我们的封神框架,开源发布了ZEN2模型。具体而言,通过引入无监督学习中提取的知识,ZEN通过N-gram方法学习不同的文本粒度信息。ZEN2使用大规模数据集和特殊的预训练策略对N-gram增强编码器进行预训练。下一步,我们将继续与ZEN团队一起探索PLM的优化,并提高下游任务的性能。
|
32 |
|
33 |
+
We open source and publicly release ZEN2 using our Fengshen Framework in collaboration with the [ZEN team](https://github.com/sinovation/ZEN2). More precisely, by bringing together knowledge extracted by unsupervised learning, ZEN learns different textual granularity information through N-gram methods. ZEN2 pre-trains the N-gram-enhanced encoders with large-scale datasets and special pre-training strategies. In the next step, we continue with the ZEN team to explore the optimization of PLM and improve the performance on downstream tasks.
|
34 |
|
35 |
### 下游效果 Performance
|
36 |
|