Instruction Tuning Datasets - a skymizer Collection

skymizer 's Collections

Instruction Tuning Datasets

Pre-Training Datasets

Domain-Specific Datasets

Alignment Algorithm Papers

Other Awesome datasets

Instruction Tuning Datasets

updated 11 days ago

For both SFT and DPO

tatsu-lab/alpaca

Viewer • Updated May 22, 2023 • 52k • 86.1k • 649

Note SFT
elichen3051/alpaca52k-alignment-handbook

Viewer • Updated 22 days ago • 52k • 9 • 1
yahma/alpaca-cleaned

Viewer • Updated Apr 10, 2023 • 51.8k • 32.8k • 447

Note SFT
HuggingFaceH4/ultrachat_200k

Viewer • Updated Feb 22 • 515k • 51.6k • 405

Note SFT
openbmb/UltraFeedback

Viewer • Updated Dec 29, 2023 • 64k • 2.63k • 292

Note SFT
HuggingFaceH4/ultrafeedback_binarized

Viewer • Updated Jan 8 • 187k • 38k • 196

Note SFT; DPO
HuggingFaceH4/deita-10k-v0-sft

Viewer • Updated Mar 1 • 20k • 3.32k • 29

Note SFT
HuggingFaceH4/orca_dpo_pairs

Viewer • Updated Apr 14 • 12.9k • 1.11k • 20

Note DPO
HuggingFaceH4/cai-conversation-harmless

Viewer • Updated Feb 2 • 44.8k • 773 • 12

Note SFT; DPO
shahules786/orca-chat

Viewer • Updated Jul 25, 2023 • 198k • 68 • 109

Note SFT
lmsys/lmsys-chat-1m

Viewer • Updated Oct 4, 2023 • 1M • 3.19k • 468

Note SFT; DPO
What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

Paper • 2312.15685 • Published Dec 25, 2023 • 16
HuggingFaceH4/no_robots

Viewer • Updated Apr 18 • 10k • 3.91k • 397

Note SFT
HuggingFaceH4/SystemChat

Viewer • Updated Mar 12 • 7.02k • 1.23k • 6
HuggingFaceH4/deita-6k-v0-sft

Viewer • Updated Jan 9 • 12k • 11
Open-Orca/OpenOrca

Viewer • Updated Oct 21, 2023 • 2.91M • 16.1k • 1.26k
Open-Orca/slimorca-deduped-cleaned-corrected

Viewer • Updated May 9 • 182k • 1.91k • 4
allenai/WildChat-1M

Viewer • Updated 3 days ago • 1.04M • 2.06k • 244
mlabonne/orpo-dpo-mix-40k

Viewer • Updated 22 days ago • 44.2k • 6.34k • 189
argilla/ultrafeedback-binarized-preferences-cleaned

Viewer • Updated Dec 11, 2023 • 60.9k • 4.25k • 103
argilla/distilabel-capybara-dpo-7k-binarized

Viewer • Updated Mar 23 • 7.56k • 31.4k • 152
argilla/OpenHermesPreferences

Viewer • Updated Mar 1 • 989k • 178 • 174

Note DPO
OpenAssistant/oasst2

Viewer • Updated Jan 11 • 135k • 3.25k • 181