uer
/

gpt2-chinese-poem

Text Generation Transformers PyTorch TensorFlow JAX Chinese gpt2 Inference Endpoints text-generation-inference

Model card Files Files and versions Community

uer commited on Mar 28, 2021

Commit

b1a5f1b

•

1 Parent(s): 50b5083

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -65,7 +65,7 @@ python3 pretrain.py --dataset_path poem_dataset.pt \
                     --learning_rate 5e-4 --batch_size 64 \
                     --embedding word_pos --remove_embedding_layernorm \
                     --encoder transformer --mask causal --layernorm_positioning pre \
-                    --target lm --tie_weight
 ```
 Finally, we convert the pre-trained model into Huggingface's format:

                     --learning_rate 5e-4 --batch_size 64 \
                     --embedding word_pos --remove_embedding_layernorm \
                     --encoder transformer --mask causal --layernorm_positioning pre \
+                    --target lm --tie_weights
 ```
 Finally, we convert the pre-trained model into Huggingface's format: