README.md

---
language:
- en
pipeline_tag: text-generation
datasets:
- practicaldreamer/RPGPT_PublicDomain-alpaca
---

# Latest Version: *0* Steps
- 0 tokens seen.


# Model Info:
- Trained from scratch.
- 8.5M parameters.
- 256 context length.

# Format:
```
<|characters|>
Nancy (Oliver Twist): Female, early 20s, ESFP, Cockney accent. Loyal...
Mr. Edward Hyde (Dr. Jekyll and Mr. Hyde): Male, late 30s, ESTP...

<|scenario|>
In an alternate Victorian London where the city's poor and downtrodden...

<|response|>
Nancy: *gently brushes her fingers across the worn book spine, before suddenly stopping as she feels another hand...
Mr. Edward Hyde: *glances at Nancy with a sinister grin, slowly pulling his hand back* No need to apologize, miss...
```

# Config:
```
batch_size: 1
dropout: 0
learning_rate: 0.00002
max_length: 256
n_embed: 256
n_head: 8
n_layer: 8
vocab_size: 8192
```