Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

9,683

Full-text search

Active filters: llama-cpp

prithivMLmods/OpenMath-8B-GGUF

Text Generation • Updated 3 days ago • 187 • 7

prithivMLmods/Llama-Magpie-3.2-3B-Instruct-GGUF

Text Generation • Updated 3 days ago • 298 • 7

nanowell/QwQ-32B-Preview-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 2.9k • 6

NikolayKozloff/Teuken-7B-instruct-commercial-v0.4-Q8_0-GGUF

Text Generation • Updated 7 days ago • 200 • 4

sbeltz/QwQ-32B-Preview-Q3_K_S-GGUF

Text Generation • Updated 6 days ago • 1.33k • 3

eltorio/Llama-3.2-3B-appreciation-F16-GGUF

Updated 1 day ago • 125 • 3

Orion-zhen/Meissa-Qwen2.5-14B-Instruct-Q6_K-GGUF

Updated Oct 25 • 277 • 2

CronoBJS/LLaMA-Mesh-Q6_K-GGUF

Text Generation • Updated 14 days ago • 166 • 2

KnutJaegersberg/Teuken-7B-instruct-commercial-v0.4-Q4_K_M-GGUF

Text Generation • Updated 7 days ago • 104 • 2

orabazes/QwQ-32B-Preview-GGUF

Text Generation • Updated 6 days ago • 455 • 2

MrRobotoAI/Loki-v2.8-8b-EROTICA-Q4_K_M-GGUF

Updated 3 days ago • 89 • 2

prithivMLmods/SmolLM2-Math-IIO-1.7B-Instruct

Text Generation • Updated about 5 hours ago • 2

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

Updated Apr 5 • 1.52k • 1

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5 • 763 • 2

DavidAU/HelpingAI-Lite-4x1b-Q6_K-GGUF

Updated Apr 9 • 10 • 1

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 4.49k • 13

gate369/Bitnet-M7-70m-Q8_0-GGUF

Updated Apr 15 • 32 • 1

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF-PTBR

Text Generation • Updated May 1 • 11 • 1

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 709 • 50

TouchNight/Yi-9B-200K-AEZAKMI-RAW-TOXIC-1-Q6_K-GGUF

Updated May 21 • 9 • 1

YorkieOH10/AlchemistCoder-DS-6.7B-Q4_K_M-GGUF

Updated May 30 • 2 • 1

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated Jun 12 • 56 • 4

HDiffusion/Llama3-8b-CunnyGPT-16bit-Q4_K_M-GGUF

Updated Jun 13 • 158 • 2

mobeetle/Saul-7B-Instruct-v1-Q4_K_M-GGUF

Updated Jun 20 • 23 • 1

fishbone64/gte-Qwen2-7B-instruct-Q8_0-GGUF

Sentence Similarity • Updated Jun 26 • 81 • 2

huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF

Updated Jul 3 • 78 • 3

jorismathijssen/t5-base-Q4_K_M-GGUF

Translation • Updated Jul 8 • 45 • 1

ibrahimkettaneh/L3-MS-Astoria-8b-Q3_K_L-GGUF

Updated Jul 12 • 5 • 1

ibrahimkettaneh/L3-MS-Astoria-8b-IQ4_NL-GGUF

Updated Jul 12 • 3 • 1

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • Updated Jul 15 • 3.03k • 2