Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,739

Full-text search

Active filters: quantized

MaziyarPanahi/Starcannon-Unleashed-12B-v1.0-GGUF

Text Generation • Updated 26 days ago • 147

MaziyarPanahi/magnum-v4-12b-GGUF

Text Generation • Updated 26 days ago • 185

MaziyarPanahi/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-GGUF

Text Generation • Updated 26 days ago • 155

MaziyarPanahi/Mistral-Nemo-Kurdish-Instruct-GGUF

Text Generation • Updated 26 days ago • 136

MaziyarPanahi/calme-3.2-instruct-3b-GGUF

Text Generation • Updated 18 days ago • 48.3k

MaziyarPanahi/calme-3.1-baguette-3b-GGUF

Text Generation • Updated 18 days ago • 164k

MaziyarPanahi/calme-3.2-baguette-3b-GGUF

Text Generation • Updated 18 days ago • 215k

MaziyarPanahi/calme-3.3-baguette-3b-GGUF

Text Generation • Updated 18 days ago • 19.8k

MaziyarPanahi/calme-3.2-qwenloi-3b-GGUF

Text Generation • Updated 18 days ago • 15k

MaziyarPanahi/calme-3.3-qwenloi-3b-GGUF

Text Generation • Updated 18 days ago • 15k

MaziyarPanahi/calme-3.1-llamaloi-3b-GGUF

Text Generation • Updated 18 days ago • 48.2k

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • Updated 18 days ago • 15.1k

dwikitheduck/gen-try1-Q4_K_M-GGUF

Updated 22 days ago • 96

fahmizainal17/Meta-Llama-3-8B-Instruct-fine-tuned

Text Generation • Updated 20 days ago • 23

shreyasmeher/ConflLlama-Alt

Text Classification • Updated 14 days ago • 192

Guchyos/gemma-2b-elyza-task

Text Generation • Updated 15 days ago • 34

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated 11 days ago • 40

dwikitheduck/gen-sql-1-Q4_K_M-GGUF

Updated 15 days ago • 55

argmaxinc/whisperkit-pro

Automatic Speech Recognition • Updated 7 days ago • 190

jsjeon/SummLlama3.2-3B-Q4_K_M-GGUF

Updated 15 days ago

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated 11 days ago • 17

neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • Updated 12 days ago • 25

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated 11 days ago • 7

TheMelonGod/NaturalLM-exl2

Text Generation • Updated 10 days ago • 6

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated 8 days ago • 8

dwikitheduck/gen-inst-1-Q4_K_M-GGUF

Updated 9 days ago • 86

qualcomm/Facial-Landmark-Detection-Quantized

Keypoint Detection • Updated 6 days ago

namannn/llama2-13b-hyperbolic-cluster-pruned

Text Generation • Updated about 20 hours ago • 137

SultanR/SmolTulu-1.7b-Instruct-GGUF

Text Generation • Updated 2 days ago • 19