roygan commited on
Commit
0b542fa
1 Parent(s): 219139b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -11,7 +11,7 @@ license: apache-2.0
11
 
12
  ## 简介 Brief Introduction
13
 
14
- 以去噪任务为微调目标的中文Transformer-XL。
15
 
16
  Chinese Transformer-XL with a denoising task as the fine-tuning objective.
17
 
@@ -23,7 +23,7 @@ Chinese Transformer-XL with a denoising task as the fine-tuning objective.
23
 
24
  ## 模型信息 Model Information
25
 
26
- 我们先使用Transformer-XL的模型结构在悟道语料库(180G版本)上进行预训练,然后在我们自主构建的去噪数据集上进行微调。其中,去噪任务是从包括 **随机插入/交换/删除/替换/句子重排** 的具有噪声的输入中重建一个流畅和干净的文本。
27
 
28
  We first pre-trained Transformer-XL on the Wudo corpus (180G version), and then fine-tuned it on a denoised dataset (developed by us). The denoise task is to reconstruct a fluent and clean text from a noisy input which includes **random insertion/swap/deletion/replacement/sentence reordering**.
29
 
 
11
 
12
  ## 简介 Brief Introduction
13
 
14
+ 以语法纠错任务为微调目标的中文Transformer-XL。
15
 
16
  Chinese Transformer-XL with a denoising task as the fine-tuning objective.
17
 
 
23
 
24
  ## 模型信息 Model Information
25
 
26
+ 我们先使用Transformer-XL的模型结构在悟道语料库(180G版本)上进行预训练,然后在我们自主构建的语法错误数据集上进行微调。其中,去噪任务是从包括 **随机插入/交换/删除/替换/句子重排** 的具有噪声的输入中重建一个流畅和干净的文本。
27
 
28
  We first pre-trained Transformer-XL on the Wudo corpus (180G version), and then fine-tuned it on a denoised dataset (developed by us). The denoise task is to reconstruct a fluent and clean text from a noisy input which includes **random insertion/swap/deletion/replacement/sentence reordering**.
29