TinyStories: How Small Can Language Models Be and Still Speak Coherent English?
Paper • 2305.07759 • Published • 50
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
I trained a 51M parameter GPT-style model on an RTX 3080 10GB using TinyStories. It can generate coherent children’s-story style text. Includes HF Transformers weights and GGUF/Ollama export. Followed https://arxiv.org/abs/2305.07759
- Downloads last month
- 8
Hardware compatibility
Log In to add your hardware
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support