uer
/

gpt2-chinese-couplet

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

uer commited on Feb 20, 2021

Commit

b60f206

•

1 Parent(s): eb5d751

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -57,7 +57,7 @@ python3 preprocess.py --corpus_path corpora/couplet.txt \
 ```
 python3 pretrain.py --dataset_path couplet_dataset.pt \
 				    --vocab_path models/google_zh_vocab.txt \
-					--output_model_path models/couplet_gpt2_base_model.bin \
 					--config_path models/gpt2/config.json \
 					--world_size 8 --gpu_ranks 0 1 2 3 4 5 6 7 \
 					--total_steps 25000 --save_checkpoint_steps 5000 --report_steps 1000 \
@@ -71,7 +71,7 @@ python3 pretrain.py --dataset_path couplet_dataset.pt \
 Finally, we convert the pre-trained model into Huggingface's format:
 ```
-python3 scripts/convert_gpt2_from_uer_to_huggingface.py --input_model_path couplet_gpt2_base_model.bin-25000 \
 														--output_model_path pytorch_model.bin \
 														--layers_num 12
 ```

 ```
 python3 pretrain.py --dataset_path couplet_dataset.pt \
 				    --vocab_path models/google_zh_vocab.txt \
+					--output_model_path models/couplet_gpt2_model.bin \
 					--config_path models/gpt2/config.json \
 					--world_size 8 --gpu_ranks 0 1 2 3 4 5 6 7 \
 					--total_steps 25000 --save_checkpoint_steps 5000 --report_steps 1000 \
 Finally, we convert the pre-trained model into Huggingface's format:
 ```
+python3 scripts/convert_gpt2_from_uer_to_huggingface.py --input_model_path couplet_gpt2_model.bin-25000 \
 														--output_model_path pytorch_model.bin \
 														--layers_num 12
 ```