bolbolzaban
/

gpt2-persian

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

khashei commited on Jan 5, 2021

Commit

ee3214d

•

1 Parent(s): ffdcecf

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ tags:
 - persian
 ---
 # GPT2-Persian
-bolbolzaban/gpt2-persian is gpt2 language model that is trained with hyper parameters similar to standard gpt2-medium with two differences:
 1. The context size is reduced from 1024 to 256 sub words in order to make the training affordable
 2. Instead of BPE, google sentence piece tokenizor is used for tokenization.
 3. The training dataset only include Persian text. All non-persian characters are replaced with especial tokens (e.g [LAT], [URL], [NUM])

 - persian
 ---
 # GPT2-Persian
+bolbolzaban/gpt2-persian is gpt2 language model that is trained with hyper parameters similar to standard gpt2-medium with following differences:
 1. The context size is reduced from 1024 to 256 sub words in order to make the training affordable
 2. Instead of BPE, google sentence piece tokenizor is used for tokenization.
 3. The training dataset only include Persian text. All non-persian characters are replaced with especial tokens (e.g [LAT], [URL], [NUM])