Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,721

Full-text search

Active filters: quantized

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 22 • 230

jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Aug 22 • 34

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 193

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • Updated Aug 23 • 270 • 1

legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • Updated Aug 25 • 319

qualcomm/MediaPipe-Face-Detection-Quantized

Object Detection • Updated 3 days ago

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • Updated Sep 6 • 661 • 1

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31 • 1.82k • 5

legraphista/xLAM-7b-r-IMat-GGUF

Text Generation • Updated Aug 31 • 718

legraphista/xLAM-8x7b-r-IMat-GGUF

Text Generation • Updated Aug 31 • 993 • 1

legraphista/xLAM-8x22b-r-IMat-GGUF

Text Generation • Updated Sep 1 • 956

byroneverson/gemma-2-27b-it-abliterated-gguf

Text Generation • Updated Sep 9 • 561 • 12

legraphista/granite-20b-code-instruct-IMat-GGUF

Text Generation • Updated Sep 1 • 653

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4 • 843k • 4

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 845k • 1

legraphista/Yi-Coder-1.5B-IMat-GGUF

Text Generation • Updated Sep 5 • 167

legraphista/Yi-Coder-1.5B-Chat-IMat-GGUF

Text Generation • Updated Sep 5 • 620

legraphista/Yi-Coder-9B-Chat-IMat-GGUF

Text Generation • Updated Sep 5 • 345 • 1

legraphista/Yi-Coder-9B-IMat-GGUF

Text Generation • Updated Sep 5 • 191

legraphista/Reflection-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Sep 9 • 1.17k • 8

legraphista/DeepSeek-V2.5-IMat-GGUF

Text Generation • Updated Sep 8 • 909 • 4

legraphista/DeepSeek-Coder-V2-Instruct-0724-IMat-GGUF

Text Generation • Updated Sep 9 • 798 • 2

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated Sep 11 • 1.07k • 3

MaziyarPanahi/ref_70_e3-GGUF

Text Generation • Updated Sep 10 • 241

legraphista/Llama-3.1-SuperNova-Lite-IMat-GGUF

Text Generation • Updated Sep 11 • 437 • 1

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated Sep 11 • 323 • 2

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated Sep 11 • 312 • 1

legraphista/reader-lm-0.5b-IMat-GGUF

Text Generation • Updated Sep 11 • 526

legraphista/reader-lm-1.5b-IMat-GGUF

Text Generation • Updated Sep 11 • 558

legraphista/datagemma-rag-27b-it-IMat-GGUF

Text Generation • Updated Sep 13 • 565