Edit Models filters

Intel/orca_dpo_pairs

allenai/ultrafeedback_binarized_cleaned

jondurbin/truthy-dpo-v0.1

Open-Orca/SlimOrca

nvidia/HelpSteer

migtissera/Synthia-v1.3

unalignment/toxic-dpo-v0.1

TIGER-Lab/MathInstruct

Muennighoff/natural-instructions

Vezora/Tested-22k-Python-Alpaca

codeparrot/apps

facebook/belebele

jondurbin/cinematika-v0.1

lmsys/lmsys-chat-1m

Squish42/bluemoon-fandom-1-1-rp-cleaned

kingbri/PIPPA-shareGPT

HuggingFaceH4/ultrachat_200k

meta-math/MetaMathQA

teknium/OpenHermes-2.5

unalignment/spicy-3.1

Open-Orca/OpenOrca

argilla/distilabel-capybara-dpo-7k-binarized

hkust-nlp/deita-10k-v0

jondurbin/airoboros-3.2

openchat/openchat_sharegpt4_dataset

argilla/ultrafeedback-binarized-preferences-cleaned

teknium/openhermes

HuggingFaceH4/ultrafeedback_binarized

athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW

Open-Orca/SlimOrca-Dedup

argilla/ultrafeedback-binarized-preferences

LDJnr/Pure-Dove

LDJnr/Verified-Camel

cerebras/SlimPajama-627B

mlabonne/chatml_dpo_pairs

argilla/distilabel-math-preference-dpo

HuggingFaceH4/capybara

alexredna/oasst2_dpo_pairs

cognitivecomputations/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split

glaiveai/glaive-function-calling-v2

wenbopan/Chinese-dpo-pairs

OpenAssistant/oasst2

HuggingFaceH4/no_robots

PygmalionAI/PIPPA

lemonilia/LimaRP

Anthropic/hh-rlhf

MaziyarPanahi/truthy-dpo-v0.1-axolotl

PKU-Alignment/PKU-SafeRLHF

allenai/ai2_arc

chargoddard/rpguild

openai/summarize_from_feedback

pankajmathur/orca_mini_v1_dataset

NeuralNovel/Neural-Story-v1

argilla/distilabel-intel-orca-dpo-pairs

databricks/databricks-dolly-15k

kyujinpy/orca_math_dpo

mlabonne/CodeLlama-2-20k

wikimedia/wikipedia

BAAI/Infinity-Instruct

Locutusque/Hercules-v3.0

argilla/OpenHermesPreferences

codefuse-ai/Evol-instruction-66k

Doctor-Shotgun/capybara-sharegpt

Doctor-Shotgun/no-robots-sharegpt

LDJnr/LessWrong-Amplify-Instruct

Norquinal/claude_multiround_chat_30k

OEvortex/vortex-mini

OpenAssistant/oasst_top1_2023-08-25

Undi95/toxic-dpo-v0.1-NoWarning

bigcode/starcoderdata

cognitivecomputations/dolphin

fka/awesome-chatgpt-prompts

glaiveai/glaive-code-assistant

imone/OpenOrca_FLAN

BramVanroy/dolly-15k-dutch

HumanLLMs/Human-Like-DPO-Dataset

Lin-Chen/ShareGPT4V

V3N0M/Jenna-50K-Alpaca-Uncensored

antiven0m/physical-reasoning-dpo

berkeley-nest/Nectar

ise-uiuc/Magicoder-OSS-Instruct-75K

pankajmathur/WizardLM_Orca

teknium/trismegistus-project

unalignment/toxic-dpo-v0.2

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

microsoft/orca-math-word-problems-200k

allenai/MADLAD-400

m-a-p/CodeFeedback-Filtered-Instruction

cis-lmu/Glot500

cognitivecomputations/dolphin-coder

jondurbin/gutenberg-dpo-v0.1

cognitivecomputations/samantha-data

oscar-corpus/OSCAR-2109

garage-bAInd/Open-Platypus

kiranpantha/dataset-for-peft-cv-nepds

open-r1/OpenR1-Math-220k

AI-MO/NuminaMath-TIR

anthracite-org/kalo-opus-instruct-22k-no-refusal

legacy-datasets/wikipedia

mozilla-foundation/common_voice_13_0

AI-MO/NuminaMath-CoT

OpenAssistant/oasst1

m-a-p/Code-Feedback

mozilla-foundation/common_voice_17_0

EleutherAI/pile

tiiuae/falcon-refinedweb

jondurbin/airoboros-2.2.1

togethercomputer/RedPajama-Data-1T

facebook/voxpopuli

HuggingFaceTB/smoltalk

microsoft/orca-agentinstruct-1M-v1

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

allenai/tulu-3-sft-mixture

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

Gryphe/Sonnet3.5-Charcard-Roleplay

ise-uiuc/Magicoder-Evol-Instruct-110K

HuggingFaceFW/fineweb

cognitivecomputations/Dolphin-2.9

argilla/dpo-mix-7k

nothingiisreal/Reddit-Dirty-And-WritingPrompts

NousResearch/hermes-function-calling-v1

anthracite-org/nopm_claude_writing_fixed

OpenCoder-LLM/opc-sft-stage1

internlm/Agent-FLAN

Locutusque/function-calling-chatml

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

yahma/alpaca-cleaned

nbeerbower/gutenberg2-dpo

OpenCoder-LLM/opc-sft-stage2

FreedomIntelligence/medical-o1-reasoning-SFT

tatsu-lab/alpaca

HuggingFaceFW/fineweb-edu

mlabonne/orpo-dpo-mix-40k

Nopm/Opus_WritingStruct

mozilla-foundation/common_voice_8_0

huggan/smithsonian_butterflies_subset

camel-ai/biology

camel-ai/physics

allura-org/Celeste-1.x-data-mixture

open-thoughts/OpenThoughts-114k

Gryphe/ChatGPT-4o-Writing-Prompts

camel-ai/chemistry

trl-lib/ultrafeedback_binarized

nvidia/HelpSteer2

anthracite-org/kalo_opus_misc_240827

HuggingFaceFW/fineweb-2

mlabonne/FineTome-100k

DigitalLearningGmbH/MATH-lighteval

grimulkan/LimaRP-augmented

openbmb/UltraFeedback

Salesforce/xlam-function-calling-60k

nbeerbower/Arkhaios-DPO

nbeerbower/Purpura-DPO

flax-sentence-embeddings/stackexchange_xml

netcat420/MFANN

TFMC/imatrix-dataset-for-japanese-llm

allenai/tulu-v2-sft-mixture

nbeerbower/gutenberg-moderne-dpo

embedding-data/sentence-compression

embedding-data/PAQ_pairs

HuggingFaceTB/cosmopedia

embedding-data/WikiAnswers

nvidia/OpenCodeReasoning

flammenai/Date-DPO-NoAsterisks

Models

608

Full-text search

Active filters: Intel/orca_dpo_pairs

premai-io/prem-1B-chat

Text Generation • Updated May 21, 2024 • 32 • 5

mudler/prem-1B-chat-Q4_0-GGUF

Text Generation • Updated May 9, 2024 • 11

mudler/prem-1B-chat-Q5_0-GGUF

Text Generation • Updated May 9, 2024 • 10 • 1

mudler/prem-1B-chat-Q8_0-GGUF

Text Generation • Updated May 9, 2024 • 3

mudler/prem-1B-chat-Q6_K-GGUF

Text Generation • Updated May 9, 2024 • 3

TeeZee/NEBULA-23.8B-v1.0-bpw4.45-h8-exl2

Text Generation • Updated May 9, 2024 • 11

ucalyptus/prem-1B-chat-MLX

Text Generation • Updated May 11, 2024 • 14 • 1

TeeZee/NEBULA-23.8B-v1.0-bpw4.34-h8-exl2

Text Generation • Updated May 12, 2024 • 11 • 1

mradermacher/NEBULA-23.8B-v1.0-GGUF

Updated May 14, 2024 • 36

mradermacher/NEBULA-23.8B-v1.0-i1-GGUF

Updated May 15, 2024 • 29 • 2

Ppoyaa/Luminaura-RP-13B

Text Generation • Updated May 15, 2024 • 8

mradermacher/Luminaura-RP-13B-GGUF

Updated May 16, 2024 • 98 • 1

QuantFactory/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated May 24, 2024 • 67 • 1

vikarti-anatra/Faro-Yi-9B-DPO-6bpw-exl2

Text Generation • Updated May 24, 2024 • 7 • 1

vikarti-anatra/Faro-Yi-9B-DPO-8bpw-exl2

Text Generation • Updated May 25, 2024 • 7 • 1

bartowski/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated May 24, 2024 • 302 • 4

vikarti-anatra/Faro-Yi-9B-DPO-gguf

Text Generation • Updated May 25, 2024 • 14 • 1

ggalmeida0/Faro-Yi-9B-DPO-Q8_0-GGUF

Text Generation • Updated May 26, 2024 • 1

kurros/stablelm-2-zephyr-1_6b-Q3_K_S-GGUF

Updated May 29, 2024 • 2

kurros/stablelm-2-zephyr-1_6b-Q3_K_M-GGUF

Updated May 29, 2024

kurros/stablelm-2-zephyr-1_6b-Q4_K_M-GGUF

Updated May 30, 2024 • 1

kurros/stablelm-2-zephyr-1_6b-Q5_K_S-GGUF

Updated May 30, 2024 • 3

kurros/stablelm-2-zephyr-1_6b-Q5_K_M-GGUF

Updated May 30, 2024 • 3

Sreevadan/DPO-Llama3-8b

Text Generation • Updated Jun 3, 2024 • 5

mradermacher/Saltware-solar-10.7b-v1.0-GGUF

Updated Jun 5, 2024 • 18

condrove10/SOLAR-10.7B-Instruct-v1.0-Q4_K_M-GGUF

Updated Jun 3, 2024 • 1

MayankRaj/MayankDPOPhi-3-Mini

Text2Text Generation • Updated Jun 9, 2024

mradermacher/piano-medley-7b-GGUF

Updated Jun 4, 2024 • 71

mradermacher/piano-medley-7b-i1-GGUF

Updated Aug 2, 2024 • 105

condrove10/SOLAR-10.7B-Instruct-v1.0-Q3_K_M-GGUF

Updated Jun 4, 2024 • 3