File size: 425 Bytes
2b1c874 ea25b20 2b1c874 144ec5e ef23b7a 078f676 2b1c874 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
datasets:
- xzuyn/Stable-Diffusion-Prompts-Deduped-2.008M
language:
- en
pipeline_tag: text-generation
---
# Latest Version: *130,000* / 97,106,275 Steps
- 8,320,000 tokens seen.
# Model Info:
Test **aitextgen** GPT-2 Model. Trained from scratch.
- 6.9M parameters.
- 64 context length.
# Config
```
batch_size: 1
dropout: 0
learning_rate: 0.0001
max_length: 64
n_embed: 256
n_head: 8
n_layer: 8
vocab_size: 2,048
``` |