HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 42.6k • 475
LLM Training from Scratch
Resources, datasets and base models for training small LLMs on consumer hardware. Focus on pre-training pipelines and data curation.
Resources, datasets and base models for training small LLMs on consumer hardware. Focus on pre-training pipelines and data curation.
