allenai/MADLAD-400
Updated
•
36
•
115
text-pretrain-data
some pretrain dataset for LLM
-
-
CASIA-LM/ChineseWebText
Viewer • Updated • 1k • 11 • 32 -
allenai/dolma
Updated • 1.33k • 763 -
allenai/peS2o
Updated • 442 • 133 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 93 • 304 -
wenge-research/yayi2_pretrain_data
Viewer • Updated • 1.68M • 30 • 50 -
togethercomputer/RedPajama-Data-V2
Viewer • Updated • 2.25M • 5.93k • 329 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 1.83k • 776 -
togethercomputer/RedPajama-Data-1T
Viewer • Updated • 1.73M • 2.66k • 1.03k -
cerebras/SlimPajama-627B
Viewer • Updated • 2.16M • 5.24k • 398 -
Tele-AI/TeleChat-PTD
Updated • 5 • 158 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 763 • 243 -
GAIR/MathPile
Preview • Updated • 392 • 171 -
EleutherAI/proof-pile-2
Updated • 502 • 159 -
vietgpt/open-web-math
Viewer • Updated • 6.32M • 2 -
meta-math/MetaMathQA
Viewer • Updated • 395k • 7.09k • 277 -
bigcode/the-stack-dedup
Viewer • Updated • 237M • 1.92k • 316 -
bigcode/the-stack
Viewer • Updated • 546M • 1.22k • 711 -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 126 • 83 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 26.6k • 439 -
Locutusque/UltraTextbooks
Viewer • Updated • 5.52M • 54 • 187 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 8.03k • 530