Update README.md
Browse files
README.md
CHANGED
|
@@ -25,6 +25,10 @@ generator = pipeline('text-generation', model, tokenizer=tokenizer, config={'max
|
|
| 25 |
sample = generator('در یک اتفاق شگفت انگیز، پژوهشگران')
|
| 26 |
```
|
| 27 |
If you are using Tensorflow import TFGPT2LMHeadModel instead of GPT2LMHeadModel.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
## Special Tokens
|
| 29 |
gpt-persian is trained for the purpose of research on Persian poetry. Because of that all english words and numbers are replaced with special tokens and only standard Persian alphabet is used as part of input text. Here is one example:
|
| 30 |
|
|
|
|
| 25 |
sample = generator('در یک اتفاق شگفت انگیز، پژوهشگران')
|
| 26 |
```
|
| 27 |
If you are using Tensorflow import TFGPT2LMHeadModel instead of GPT2LMHeadModel.
|
| 28 |
+
|
| 29 |
+
## Finetuning with custom dataset
|
| 30 |
+
See this [Github Repo](https://github.com/khashei/bolbolzaban-gpt2-persian).
|
| 31 |
+
|
| 32 |
## Special Tokens
|
| 33 |
gpt-persian is trained for the purpose of research on Persian poetry. Because of that all english words and numbers are replaced with special tokens and only standard Persian alphabet is used as part of input text. Here is one example:
|
| 34 |
|