Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

28,430

Full-text search

Active filters: gguf

fmenol/stealthmo-8B-qlora

Updated about 1 hour ago

MrRobotoAI/test007-Q4_K_M-GGUF

Updated about 2 hours ago

Pyroserenus/Orthrus-12b-v0.8-Q5_K_M-GGUF

Updated about 2 hours ago

MrRobotoAI/test006-Q4_K_M-GGUF

Updated about 2 hours ago

RichardErkhov/elinas_-_Llama-3-13B-Instruct-gguf

Updated 7 minutes ago

MrRobotoAI/test001-Q4_K_M-GGUF

Updated about 2 hours ago

BeaverAI/Gemmasutra-9B-v2a-GGUF

Updated about 1 hour ago

mgonzs13/adapter-phi-3-mini-mental-health-GGUF

Updated about 2 hours ago

jdumanski/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated about 1 hour ago

noxinc/gembode-2b-ultraalpaca-Q5_K_M-GGUF

Updated about 1 hour ago

MaziyarPanahi/Qwen2-Math-1.5B-Instruct-GGUF

Text Generation • Updated 41 minutes ago

openbmb/MiniCPM-V-2-gguf

Updated 17 minutes ago

Daemontatox/capyredq8

Updated about 1 hour ago

RichardErkhov/itzme091_-_llama-3-8b-chat-financial-gguf

Updated 2 minutes ago

mradermacher/NurseButtercup-4x7B-bf16-GGUF

Updated 11 minutes ago

bartowski/Qwen2-Math-1.5B-Instruct-GGUF

Text Generation • Updated 1 minute ago

5fp/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_S-GGUF

Updated 28 minutes ago

legraphista/Qwen2-Math-1.5B-Instruct-IMat-GGUF

Text Generation • Updated 20 minutes ago

legraphista/Qwen2-Math-7B-Instruct-IMat-GGUF

Text Generation • Updated less than a minute ago

Daemontatox/capyredqkm

Updated less than a minute ago