Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,612

Full-text search

Active filters: dpo

sfulay/zephyr-7b-dpo-full-gpt-reward-scale-05

Updated Sep 3 • 1

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2

Updated Sep 3 • 5

mradermacher/uf-tulu-2-7b-dpo-i1-GGUF

Updated Sep 2 • 210

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-05

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-05

Updated Sep 3 • 3

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-group-dpo

Text Generation • Updated Sep 3 • 5

mradermacher/zephyr-7b-hh-dpo-i1-GGUF

Updated Sep 3 • 374

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-dpo-2

Text Generation • Updated Sep 3 • 16

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-coding-dpo-2

Text Generation • Updated Sep 3 • 8

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-dpo-2

Text Generation • Updated Sep 3 • 8

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-logic-dpo-2

Text Generation • Updated Sep 3 • 13

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-dpo-2

Text Generation • Updated Sep 3 • 12

tsavage68/Na_L3_1000steps_1e6rate_03beta_cSFTDPO

Text Generation • Updated Sep 4 • 7

NicholasCorrado/tinyllama-1.1b-chat-v1.0-rlced-conifer-3-1-dpo

Text Generation • Updated Sep 4 • 11

NicholasCorrado/tulu-2-7b-rlced-conifer-dpo

Text Generation • Updated Sep 4 • 8

tsavage68/Na_L3_1000steps_1e6rate_01beta_cSFTDPO

Text Generation • Updated Sep 4 • 5

NanQiangHF/llama3.1_8b_dpo_bwgenerator

Updated Sep 18 • 8

CultriX/Lama-DPOlphin-8B

Text Generation • Updated Sep 4 • 16 • 1

tsavage68/Na_L3_150steps_1e6rate_01beta_cSFTDPO

Text Generation • Updated Sep 4 • 5

tsavage68/Na_L3_100steps_1e6rate_03beta_cSFTDPO

Text Generation • Updated Sep 4 • 5

NicholasCorrado/zephyr-7b-uf-rlced-conifer-dpo-2e

Text Generation • Updated Sep 6 • 9

tsavage68/Na_L3_1000steps_1e6rate_05beta_cSFTDPO

Text Generation • Updated Sep 4 • 5

tsavage68/Na_L3_100steps_1e6rate_05beta_cSFTDPO

Text Generation • Updated Sep 4 • 5

CultriX/Lama-DPOlphin-8B-Q3_K_S-GGUF

Text Generation • Updated Sep 4 • 49 • 1

CultriX/Lama-DPOlphin-8B-Q3_K_M-GGUF

Text Generation • Updated Sep 4 • 19 • 1

CultriX/Lama-DPOlphin-8B-Q4_K_S-GGUF

Text Generation • Updated Sep 4 • 28 • 1

CultriX/Lama-DPOlphin-8B-Q5_K_S-GGUF

Text Generation • Updated Sep 4 • 24 • 1

CultriX/Lama-DPOlphin-8B-Q5_K_M-GGUF

Text Generation • Updated Sep 4 • 17 • 1

CultriX/Lama-DPOlphin-8B-Q8_0-GGUF

Text Generation • Updated Sep 4 • 25 • 1

QuantFactory/Fireball-3.1-8B-ORPO-GGUF

Text Generation • Updated Sep 4 • 168 • 2