Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,422

Full-text search

Active filters: 5-bit

NobodySpecial/Qwen2.5-72B-exl2-5.0bpw

Text Generation • Updated Sep 20 • 105 • 2

DrNicefellow/Qwen2.5-7B-Instruct-5.0bpw-exl2

Updated Sep 20 • 3

DrNicefellow/Qwen2.5-14B-Instruct-5.0bpw-exl2

Updated Sep 21 • 4

DrNicefellow/Qwen2.5-Coder-7B-Instruct-5.0bpw-exl2

Updated Sep 21 • 8

DrNicefellow/Qwen2.5-Math-7B-Instruct-5.0bpw-exl2

Updated Sep 21 • 5

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.1-5.0bpw-h6-exl2

Updated Sep 27 • 3

BigHuggyD/gghfez_SmartMaid-123b_exl2_5.0bpw_h6

riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2

Text Generation • Updated Sep 30 • 10

SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-5.0bpw

Updated Oct 1 • 1

Kotokin/Magnum-v1-72b-Qwen2.5-5bpw

Updated Oct 4 • 7

altomek/Llama-3.1-70B-Instruct-5bpw-EXL2

Text Generation • Updated Oct 10 • 6

MikeRoz/TheDrummer_Behemoth-123B-v1-5.0bpw-h6-exl2

Updated Oct 10 • 53 • 3

schnapper79/lumikabra-behemoth-123b-exl2-5.0bpw

Text Generation • Updated Oct 11 • 25

BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_5.0bpw_h6

Updated Oct 11 • 4

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-5.0-bpw

Updated Oct 11 • 6

Ya211/llamaEXL

Text Generation • Updated Oct 13 • 6

schnapper79/lumikabra_behemoth_195b-exl2-5.0bpw

Text Generation • Updated Oct 14 • 8

schnapper79/lumikabra_behemoth_195B_v2-exl2-5.0bpw

Text Generation • Updated Oct 16 • 16 • 1

MaziyarPanahi/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 17 • 808 • 3

softwareweaver/Twilight-Large-123B-EXL2-5bpw

Text Generation • Updated Oct 17 • 22 • 1

BigHuggyD/schnapper79_lumikabra-195B_v0.3_exl2_5.0bpw_h6

Text Generation • Updated Oct 18 • 7

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-Revised-GGUF

Text Generation • Updated Oct 20 • 37

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-v1.2-GGUF

Text Generation • Updated Oct 20 • 191

MaziyarPanahi/Phi-3-mini-4K-instruct-cpo-simpo-GGUF

Text Generation • Updated Oct 20 • 88

MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • Updated Oct 20 • 439 • 1

Proverbial1/magnum-v4-123b_exl2_5.0bpw_h8

Text Generation • Updated Oct 21 • 26

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.2-5.0bpw-h6-exl2

Updated Oct 22 • 10

MaziyarPanahi/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 23 • 268

jth01/aya-expanse-8b-5.0bpw-exl2

Text Generation • Updated 30 days ago • 11

async0x42/ArliAI_Mistral-Nemo-12B-ArliAI-RPMax-v1.2-exl2_5bpw

Updated 30 days ago • 13