Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,7 @@ license: apache-2.0
|
|
11 |
|
12 |
## 简介 Brief Introduction
|
13 |
|
14 |
-
|
15 |
|
16 |
Chinese Transformer-XL with a denoising task as the fine-tuning objective.
|
17 |
|
@@ -23,7 +23,7 @@ Chinese Transformer-XL with a denoising task as the fine-tuning objective.
|
|
23 |
|
24 |
## 模型信息 Model Information
|
25 |
|
26 |
-
我们先使用Transformer-XL的模型结构在悟道语料库(180G版本)
|
27 |
|
28 |
We first pre-trained Transformer-XL on the Wudo corpus (180G version), and then fine-tuned it on a denoised dataset (developed by us). The denoise task is to reconstruct a fluent and clean text from a noisy input which includes **random insertion/swap/deletion/replacement/sentence reordering**.
|
29 |
|
|
|
11 |
|
12 |
## 简介 Brief Introduction
|
13 |
|
14 |
+
以语法纠错任务为微调目标的中文Transformer-XL。
|
15 |
|
16 |
Chinese Transformer-XL with a denoising task as the fine-tuning objective.
|
17 |
|
|
|
23 |
|
24 |
## 模型信息 Model Information
|
25 |
|
26 |
+
我们先使用Transformer-XL的模型结构在悟道语料库(180G版本)上进行预训练,然后在我们自主构建的语法错误数据集上进行微调。其中,去噪任务是从包括 **随机插入/交换/删除/替换/句子重排** 的具有噪声的输入中重建一个流畅和干净的文本。
|
27 |
|
28 |
We first pre-trained Transformer-XL on the Wudo corpus (180G version), and then fine-tuned it on a denoised dataset (developed by us). The denoise task is to reconstruct a fluent and clean text from a noisy input which includes **random insertion/swap/deletion/replacement/sentence reordering**.
|
29 |
|