File size: 744 Bytes
965c9c1 944f752 2717c7c 965c9c1 4e3e0e5 944f752 415379f 4e3e0e5 415379f 6463786 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
language: en
tags:
- gpt
- text-generation
license: gpl
widget:
- text: "Once upon a time, "
---
## Keras Implementation of Text generation with a miniature GPT
This repo contains the model and the notebook [to this Keras example on Text generation with a miniature GPT](https://keras.io/examples/generative/text_generation_with_miniature_gpt/).
Full credits to: [fchollet](https://twitter.com/fchollet)
## Background Information
This example demonstrates how to implement text generation with a miniature GPT model. The model consists of a single Transformer block with causal masking in its attention layer.
## Datasets
IMDB sentiment classification dataset for training. The model generates new movie reviews for a given prompt. |