File size: 1,328 Bytes
0e9eab5 0cb477c a6cdb54 0cb477c a6cdb54 0cb477c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
---
license: mit
language:
- ru
metrics:
- perplexity
- bleu
- rouge
library_name: transformers
pipeline_tag: text-generation
---
This text generator is based on OpenAI GPT2 model from HuggingFace
Base model went through two step of learning
## First - Finetining of base model
On this step model is finetuned on dataset of single sentence from the texts of Dostovesky F.M.
Training parameters:
* Epoch = 10
* Learning Rate = 1e-3
* Optimizer = AdamW
* Scheduler = OneCycleLR
* Training env = PyTorch
![image.png](https://cdn-uploads.huggingface.co/production/uploads/645ced0dce72244df7b0f6d2/Mvp2ouBpVkK8t4CfuBvx7.png)
![image.png](https://cdn-uploads.huggingface.co/production/uploads/645ced0dce72244df7b0f6d2/_AiPUPQOi5-raYSyZNohh.png)
## Second - RL
On this step finetuned model went trough reinforcement learning pipline with TRL library.
Training parameters:
* Epoch = 30
* Trainer = PPO
* Query texts = first 100 texts from dataset, trimmed by first 3 words
* Reward = score from [binary classifier](https://huggingface.co/Roaoch/CyberClassic-Discriminator) multiplied by 10
![image.png](https://cdn-uploads.huggingface.co/production/uploads/645ced0dce72244df7b0f6d2/Mv_8ZAfml6tPcdXBOXcQG.png)
![image.png](https://cdn-uploads.huggingface.co/production/uploads/645ced0dce72244df7b0f6d2/ZbeI0Tq6eSy-_Tl_gK-sz.png) |