YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
twitch-nanoGPT 💬🤖
A tiny transformer model trained on Twitch chat data, based on Andrej Karpathy's nanoGPT tutorial.
🚀 What This Is
This project fine-tunes a small GPT-style language model entirely on Twitch chat messages. The goal is to generate hilariously chaotic, spammy, and semi-intelligible Twitch gibberish — just like a real stream chat!
🧠 How It's Built
- Base: Andrej Karpathy's
nanoGPTminimal transformer implementation - Dataset: Twitch chat logs scraped from a stream or VOD (cleaned & formatted)
- Training: Done locally with modified hyperparameters for short-context chat
- Generation: Produces absurd chat messages
🧼 Preprocessing
Twitch chat messages were:
- Lowercased
- removed usernames
- removed @'s from chat messages
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support