A model based on UberHaxorNova's Twitch chat

Trained on over 700 vods worth of chat and with some scuffed filtering it became a 300mb dataset.

Dataset

The dataset was created by downloading all the available vods at the time of creation as a json file and stripping out all the chat messages into a simple line-by-line text file.

Training

This was trained using aitextgen, created by Max Woolf, using the example notebook found here. Using GPT-2's 124M model as the base, it was trained for 3000 steps and produces an output scuffed enough to look like a real Twitch chat user.

Use

This was created as a fun little project for the discord server and as such, should only be used for fun and not to harm people. This model must also follow the ethics guide of the tool that created it https://github.com/minimaxir/aitextgen/blob/master/docs/ethics.md