|
--- |
|
license: mit |
|
base_model: gpt2 |
|
model-index: |
|
- name: gpt2-fantasy |
|
results: [] |
|
language: |
|
- en |
|
metrics: |
|
- accuracy |
|
library_name: transformers |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information Keras had access to. You should |
|
probably proofread and complete it, then remove this comment. --> |
|
|
|
# gpt2-fantasy |
|
|
|
This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on IMDB fantasy synopsis dataset. |
|
|
|
|
|
## Model description |
|
|
|
This model was fine-tuned with intention of generating short fantasy stories based on given keywords. You can test this model [here](https://huggingface.co/spaces/egosumkira/GPT2-Fantasy). |
|
|
|
## Training data |
|
|
|
Training data was parsed from IMDB website and consists of keywords-synopsis pairs. Method of encoding data was inspired from [this repo](https://github.com/minimaxir/gpt-2-keyword-generation). |
|
|
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- optimizer: Adam |
|
- dropout: 0.2 |
|
- learning schedule: exponential decay |
|
- epochs: 4 |
|
|
|
### Training results |
|
|
|
Keywords: time travel, magic, rescue. \ |
|
Output: A group of young men find themselves in the middle of a desert, and must band together to save their friend from an evil force bent on destroying his world. But what if they don't trust each other? Is there something that might help them at all costs? Can they break the spell before it's too late? Will they be able to stop this Evil once and for all? Or will they do anything about it? Above all, can they make things right with humanity? And above all, is there some really good magic going on here? What are they trying to do? |
|
|
|
### Framework versions |
|
|
|
- Transformers 4.29.2 |
|
- TensorFlow 2.12.0 |
|
- Tokenizers 0.13.3 |
