Edit Models filters

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,046

Full-text search

Active filters: dpo

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • Updated about 23 hours ago • 194 • 7

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3

Text Generation • Updated 3 days ago • 241 • 6

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2

Text Generation • Updated 21 days ago • 2.07k • 5

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 19.1k • 43

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2

Text Generation • Updated 3 days ago • 177 • 2

argilla/notus-7b-v1

Text Generation • Updated Dec 5, 2023 • 7.47k • 113

BramVanroy/GEITje-7B-ultra

Text Generation • Updated Apr 26 • 3.83k • 31

TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF

Updated Jan 31 • 20.2k • 65

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 597 • 14

ContextualAI/Contextual_KTO_Mistral_PairRM

Text Generation • Updated Apr 26 • 2.99k • 25

CorticalStack/mistral-7b-distilabel-truthy-dpo

Text Generation • Updated Mar 5 • 2.8k • 1

NobodyExistsOnTheInternet/mistral-7b-base-dpo-run

Updated Mar 14 • 1 • 1

VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct

Text Generation • Updated 30 days ago • 24.9k • 43

VAGOsolutions/Llama-3-SauerkrautLM-70b-Instruct

Text Generation • Updated 8 days ago • 1.38k • 9

MaziyarPanahi/Llama-3-8B-Instruct-64k

Text Generation • Updated Apr 25 • 266 • 9

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4

Text Generation • Updated 21 days ago • 2.28k • 10

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1

Text Generation • Updated 3 days ago • 187 • 1

Holarissun/REPROD_dpo_helpfulhelpful_gpt3_subset-1_modelgemma2b_maxsteps10000_bz8_lr1e-05

Updated 5 days ago • 1 • 1

mradermacher/Daredevil-8B-abliterated-dpomix-i1-GGUF

Updated about 9 hours ago • 4.97k • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 4 • 10

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • Updated Oct 31, 2023 • 1.24k • 19

lewtun/zephyr-7b-dpo-full

Text Generation • Updated Jan 5 • 1

alignment-handbook/zephyr-7b-dpo-full

Text Generation • Updated Jan 10 • 2.35k • 2

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9 • 145 • 7

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 1 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

ContextualAI/archangel_sft_pythia1-4b

Text Generation • Updated Jan 11 • 77

ContextualAI/archangel_sft_pythia2-8b

Text Generation • Updated Jan 11 • 28

ContextualAI/archangel_sft_pythia6-9b

Text Generation • Updated Jan 11 • 15