allenai/MADLAD-400
Updated
•
83.8k
•
128
text-pretrain-data
some pretrain dataset for LLM
-
-
CASIA-LM/ChineseWebText
Viewer • Updated • 1k • 4.03k • 37 -
allenai/dolma
Updated • 1.06k • 848 -
allenai/peS2o
Updated • 2.02k • 149 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 5.77k • 340 -
wenge-research/yayi2_pretrain_data
Viewer • Updated • 1.68M • 1.26k • 51 -
togethercomputer/RedPajama-Data-V2
Updated • 3.97k • 347 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 24.2k • 814 -
togethercomputer/RedPajama-Data-1T
Viewer • Updated • 1.73M • 1.55k • 1.06k -
cerebras/SlimPajama-627B
Preview • Updated • 32.3k • 426 -
Tele-AI/TeleChat-PTD
Updated • 950 • 164 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 5.36k • 274 -
GAIR/MathPile
Preview • Updated • 274 • 182 -
EleutherAI/proof-pile-2
Updated • 6.78k • 183 -
vietgpt/open-web-math
Viewer • Updated • 6.32M • 50 -
meta-math/MetaMathQA
Viewer • Updated • 395k • 6.31k • 329 -
bigcode/the-stack-dedup
Viewer • Updated • 237M • 9.73k • 335 -
bigcode/the-stack
Viewer • Updated • 546M • 10.1k • 738 -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 65 • 89 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 10.6k • 475 -
Locutusque/UltraTextbooks
Viewer • Updated • 5.52M • 1.34k • 194 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 8.73k • 564