Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,491

Full-text search

Active filters: chat

lmstudio-community/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19 • 390 • 2

mlx-community/Qwen2.5-14B-Instruct-8bit

Text Generation • Updated Sep 18 • 72 • 2

mlx-community/Qwen2.5-14B-Instruct-4bit

Text Generation • Updated Sep 18 • 2.87k • 2

mlx-community/Qwen2.5-7B-Instruct-4bit

Text Generation • Updated 18 days ago • 762 • 3

second-state/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20 • 202 • 2

QuantFactory/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated 18 days ago • 982 • 2

TheRains/Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 19 • 36 • 1

QuantFactory/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated 18 days ago • 2.64k • 5

mlx-community/Qwen2.5-72B-Instruct-8bit

Text Generation • Updated Sep 19 • 109 • 3

Qwen/Qwen2.5-Math-7B-Instruct

Text Generation • Updated Sep 23 • 90.9k • 38

LoneStriker/Qwen2.5-72B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 26 • 1

LoneStriker/Qwen2.5-72B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 18 • 4

MaziyarPanahi/calme-2.2-qwen2.5-72b

Text Generation • Updated Sep 29 • 2.82k • 6

ThomasBaruzier/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 23 • 905 • 1

anthracite-org/magnum-v4-72b

Text Generation • Updated Oct 19 • 1.02k • 21

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated 6 days ago • 659 • 1

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • Updated 6 days ago • 706 • 2

v000000/Qwen2.5-Lumen-14B

Text Generation • Updated Oct 3 • 2.7k • 15

QuantFactory/Qwen2.5-Lumen-14B-GGUF

Text Generation • Updated Sep 21 • 275 • 3

mradermacher/Qwen2.5-Lumen-14B-GGUF

Updated Sep 22 • 478 • 4

mradermacher/Qwen2.5-Lumen-14B-i1-GGUF

Updated Sep 22 • 643 • 7

mradermacher/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Updated Sep 24 • 1.28k • 7

byroneverson/Mistral-Small-Instruct-2409-abliterated

Text Generation • Updated Sep 24 • 120 • 10

mradermacher/Mistral-Small-Instruct-2409-abliterated-GGUF

Updated Sep 24 • 1.3k • 2

mradermacher/Qwen2.5-7B-Instruct-abliterated-v2-i1-GGUF

Updated Sep 24 • 346 • 3

anthracite-org/magnum-v4-72b-exl2

Text Generation • Updated Oct 19 • 163 • 4

mradermacher/Qwen2.5-14B-Instruct-abliterated-GGUF

Updated Sep 26 • 282 • 6

bartowski/Qwen2.5-Coder-7B-Instruct-exl2

Text Generation • Updated Sep 29 • 106 • 5

anthracite-org/magnum-v4-72b-gguf

Text Generation • Updated Oct 20 • 24.4k • 6

anthracite-org/magnum-v4-9b-gguf

Text Generation • Updated Oct 20 • 1.97k • 13