Omkar2118/datasets huggingface dataset:
TinyStories

Dataset containing synthetically generated (by GPT-3.5 and GPT-4) short stories that only use a small vocabulary.

Introducing paper: TinyStories: How Small Can Language Models Be and Still Speak Coherent English?