Update README.md

README.md

@@ -46,18 +46,18 @@ Training data contains 800,000 Chinese ancient poems which are collected by [chi
 
 ## Training procedure
 
-The model is pre-trained by [UER-py](https://github.com/dbiir/UER-py/) on [Tencent Cloud TI-ONE](https://cloud.tencent.com/product/tione/). We pre-train 200,000 steps with a sequence length of 128.
+The model is pre-trained by [UER-py](https://github.com/dbiir/UER-py/) on [Tencent Cloud TI-ONE](https://cloud.tencent.com/product/tione/). We pre-train 200,000 steps with a sequence length of 128. We use extended vocabulary to handle out-of-vocabulary words. The Chinese character that occurs greater than or equal to 100 in poem corpus is added to the vocabulary.
 
 ```
 python3 preprocess.py --corpus_path corpora/poem.txt \
-					  --vocab_path models/google_zh_vocab.txt \
+					  --vocab_path models/poem_zh_vocab.txt \
 					  --dataset_path poem_dataset.pt --processes_num 16 \
 					  --seq_length 128 --target lm 
 ```
 
 ```
 python3 pretrain.py --dataset_path poem_dataset.pt \
-				    --vocab_path models/google_zh_vocab.txt \
+				    --vocab_path models/poem_zh_vocab.txt \
 					--output_model_path models/poem_gpt2_model.bin \
 					--config_path models/gpt2/config.json \
 					--world_size 8 --gpu_ranks 0 1 2 3 4 5 6 7 \