RWKV World v3 Corpus - a hevok Collection

hevok 's Collections

RWKV World v3 Corpus

RWKV World v3 Corpus

updated 4 days ago

RWKV World v3.0 Dataset for training RWKV-7 Goose World v3 models

wikimedia/wikipedia

Viewer • Updated Jan 9, 2024 • 61.6M • 99.2k • 758

Note v2 Oriignally: https://huggingface.co/datasets/olm/wikipedia
cerebras/SlimPajama-627B

Preview • Updated Jul 7, 2023 • 88.8k • 456

Note v2 We removed the CC and C4 components of SlimPajama from the corpus for World v3
allenai/peS2o

Updated Oct 13, 2024 • 3.07k • 168

Note v2
NortheasternUniversity/big_patent

Updated Jan 18, 2024 • 1.2k • 57

Note v2
pile-of-law/pile-of-law

Updated Jan 8, 2023 • 4.36k • 229

Note v2
bigcode/starcoderdata

Viewer • Updated May 16, 2023 • 207M • 3.9k • 418

Note v2 For StarCoder, we now include all datasets, instead of just those datasets with at least 10 stars
oscar-corpus/OSCAR-2301

Updated Apr 18, 2023 • 8.7k • 149

Note v2
wecover/OPUS_TED2020

Viewer • Updated Jan 31, 2024 • 79.3M • 22.7k

Note v2
suolyer/pile_opensubtitles

Viewer • Updated Mar 27, 2023 • 1.26k • 39 • 1

Note v2
suolyer/pile_youtubesubtitles

Viewer • Updated Mar 26, 2023 • 668 • 43 • 1
RyokoAI/Honeyfeed3600

Preview • Updated Apr 5, 2023 • 76 • 4

Note v2
botp/RyokoAI_Syosetu711K

Preview • Updated Aug 18, 2023 • 220 • 23

Note v2 Correct URL?
marianna13/fanfics

Viewer • Updated Mar 25, 2023 • 5.25M • 1.57k • 4

Note v2
marianna13/gamedev

Viewer • Updated Feb 16, 2023 • 40.7k • 34 • 4

Note v2
marianna13/IA-books

Viewer • Updated Mar 22, 2023 • 1.92M • 312

Note v2
marianna13/libgen

Viewer • Updated Apr 13, 2023 • 737k • 138 • 3

Note v2
marianna13/research_gate

Viewer • Updated Feb 10, 2023 • 66.2k • 7 • 1

Note v2
marianna13/superuser

Viewer • Updated Feb 16, 2023 • 28.5k • 2 • 1

Note v2
marianna13/the-eye

Viewer • Updated Mar 15, 2023 • 345k • 122

Note v2
marianna13/random_dataset

Viewer • Updated Feb 25, 2023 • 4.27M • 258 • 1

Note v2
marianna13/vault_text

Viewer • Updated Feb 19, 2023 • 49.2k • 477

Note v2
marianna13/zlib

Viewer • Updated Mar 17, 2023 • 943k • 253

Note v2
SaylorTwift/the_pile_books3_minus_gutenberg

Viewer • Updated Mar 3, 2023 • 193k • 1.16k • 12

Note v2
JeanKaddour/minipile

Viewer • Updated Jun 20, 2023 • 1.01M • 3.78k • 119

Note v2
Helsinki-NLP/tatoeba_mt

Updated Oct 8, 2024 • 7.64k • 59

Note v2
shahules786/PoetryFoundationData

Viewer • Updated Mar 1, 2023 • 13.9k • 105 • 2

Note v2
hoskinson-center/proof-pile

Viewer • Updated Aug 19, 2023 • 363k • 25.4k • 58

Note v2
P1ayer-1/reddit-math

Viewer • Updated Apr 5, 2023 • 78.2k • 7 • 2

Note v2
allenai/soda

Viewer • Updated Jan 4, 2023 • 1.49M • 448 • 141

Note v2
amishshah/song_lyrics

Viewer • Updated Apr 25, 2023 • 2.94M • 65 • 16

Note v2
roneneldan/TinyStories

Viewer • Updated Aug 12, 2024 • 2.14M • 25.1k • 629

Note v2
0x22almostEvil/multilingual-wikihow-qa-16k

Viewer • Updated May 13, 2023 • 16.8k • 1.47k • 9

Note v2
tatsu-lab/alpaca

Viewer • Updated May 22, 2023 • 52k • 36.4k • 741

Note v2
camel-ai/math

Viewer • Updated Jun 22, 2023 • 50k • 331 • 106

Note v2
camel-ai/code

Preview • Updated May 23, 2023 • 104 • 37

Note v2
camel-ai/physics

Viewer • Updated May 23, 2023 • 20k • 401 • 79

Note v2
camel-ai/chemistry

Viewer • Updated May 23, 2023 • 20k • 270 • 46

Note v2
camel-ai/ai_society

Preview • Updated May 23, 2023 • 143 • 42

Note v2
camel-ai/biology

Viewer • Updated May 23, 2023 • 20k • 402 • 47

Note v2
databricks/databricks-dolly-15k

Viewer • Updated Jun 30, 2023 • 15k • 15.1k • 797

Note v2
WizardLMTeam/WizardLM_evol_instruct_70k

Viewer • Updated Mar 10, 2024 • 70k • 397 • 190

Note v2
nomic-ai/gpt4all_prompt_generations

Viewer • Updated Apr 13, 2023 • 438k • 143 • 127

Note v2
allenai/dolma

Updated Apr 17, 2024 • 1.6k • 882

Note v2.1
glaiveai/glaive-code-assistant-v3

Viewer • Updated May 20, 2024 • 950k • 242 • 46

Note v2.1
m-a-p/Code-Feedback

Viewer • Updated Feb 26, 2024 • 66.4k • 347 • 206

Note v2.1
HuggingFaceTB/cosmopedia

Viewer • Updated Aug 12, 2024 • 31.1M • 26.8k • 592

Note v2.1
cognitivecomputations/SystemChat-2.0

Preview • Updated May 31, 2024 • 182 • 58

Note v2.1
migtissera/Tess-v1.5

Viewer • Updated May 29, 2024 • 126k • 81 • 59

Note v2.1
openbmb/UltraInteract_sft

Viewer • Updated Apr 5, 2024 • 289k • 9.52k • 122

Note v2.1
Magpie-Align/Llama-3-Magpie-Pro-1M-v0.1

Viewer • Updated Aug 21, 2024 • 1M • 611 • 19

Note v2.1
Magpie-Align/Magpie-Air-MT-300K-v0.1

Viewer • Updated Jul 3, 2024 • 300k • 253 • 1

Note v2.1
Magpie-Align/Magpie-Qwen2-Pro-1M-v0.1

Viewer • Updated Jul 3, 2024 • 1M • 337 • 14

Note v2.1
Magpie-Align/Magpie-Phi3-Pro-300K-Filtered

Viewer • Updated Jul 3, 2024 • 300k • 212 • 6

Note v2.1
Magpie-Align/Magpie-Gemma2-Pro-200K-Filtered

Viewer • Updated Jul 22, 2024 • 200k • 249 • 15

Note v2.1
mlfoundations/dclm-baseline-1.0

Preview • Updated Jul 22, 2024 • 355k • 209

Note v3 For DCLM-baseline, we include only global-shard_10_of_10
stanford-oval/ccnews

Viewer • Updated Aug 31, 2024 • 893M • 5.81k • 16

Note v3
HuggingFaceFW/fineweb-edu

Viewer • Updated Jan 31 • 3.3B • 516k • 649

Note v3
math-ai/TemplateGSM

Viewer • Updated 6 days ago • 14.5M • 766 • 13

Note v3
EleutherAI/proof-pile-2

Updated Oct 25, 2023 • 10.5k • 194

Note v3
HuggingFaceTB/smollm-corpus

Viewer • Updated Sep 6, 2024 • 237M • 12.4k • 311

Note v3
TIGER-Lab/WebInstructSub

Viewer • Updated Oct 27, 2024 • 2.34M • 2.3k • 146

Note v3
H-D-T/Buzz-V1.2

Viewer • Updated Oct 30, 2024 • 3.14M • 428 • 6

Note v3
TIGER-Lab/SKGInstruct

Preview • Updated Apr 9, 2024 • 224 • 28

Note v3
Muennighoff/flan

Viewer • Updated Dec 23, 2022 • 3.53M • 1.52k • 50

Note v3