Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

4,460

Full-text search

Active filters: code

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F32-GGUF

Text Generation • Updated 16 days ago • 17 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • Updated 16 days ago • 13 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F32-GGUF

Text Generation • Updated 16 days ago • 27 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F16-GGUF

Text Generation • Updated 16 days ago • 27 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • Updated 16 days ago • 12 • 1

lmstudio-community/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 11 days ago • 2.8k • 3

lmstudio-community/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated 11 days ago • 1k • 1

lmstudio-community/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 11 days ago • 288 • 1

lmstudio-community/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 11 days ago • 320 • 3

bartowski/Qwen2.5.1-Coder-1.5B-Instruct-GGUF

Text Generation • Updated 15 days ago • 3.66k • 1

mlx-community/Qwen2.5.1-Coder-7B-Instruct-4bit

Text Generation • Updated 13 days ago • 97 • 2

mlx-community/Qwen2.5.1-Coder-7B-Instruct-8bit

Text Generation • Updated 13 days ago • 139 • 2

tensorblock/bloom-1b1-GGUF

Text Generation • Updated 6 days ago • 425 • 1

BSC-LT/salamandra-2b-instruct-aina-hack

Text Generation • Updated 14 days ago • 35 • 1

theo77186/Qwen2.5-Coder-7B-Instruct-20241106

Text Generation • Updated 11 days ago • 22 • 3

QuantFactory/Typst-Coder-9B-GGUF

Text Generation • Updated 13 days ago • 339 • 3

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated 4 days ago • 1.7k • 2

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated 4 days ago • 348 • 2

Qwen/Qwen2.5-Coder-0.5B-Instruct-AWQ

Text Generation • Updated 4 days ago • 158 • 1

Qwen/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 11 days ago • 1.33k • 1

QuantFactory/Phi-3-mini-128k-instruct-abliterated-v3-GGUF

Text Generation • Updated 12 days ago • 446 • 3

bartowski/Qwen2.5-Coder-0.5B-GGUF

Text Generation • Updated 11 days ago • 520 • 1

bartowski/Qwen2.5-Coder-3B-GGUF

Text Generation • Updated 11 days ago • 1.33k • 1

bartowski/Qwen2.5-Coder-14B-GGUF

Text Generation • Updated 11 days ago • 3.19k • 2

bartowski/Qwen2.5-Coder-32B-GGUF

Text Generation • Updated 11 days ago • 4.84k • 7

lmstudio-community/Qwen2.5-Coder-32B-GGUF

Text Generation • Updated 11 days ago • 1.01k • 2

mlx-community/Qwen2.5-Coder-32B-4bit

Text Generation • Updated 10 days ago • 122 • 1

mlx-community/Qwen2.5-Coder-32B-8bit

Text Generation • Updated 10 days ago • 86 • 1

mlx-community/Qwen2.5-Coder-32B-bf16

Text Generation • Updated 10 days ago • 45 • 1

mlx-community/Qwen2.5-Coder-14B-Instruct-bf16

Text Generation • Updated 10 days ago • 38 • 1