Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Other with no match

Models

23,960

Full-text search

Active filters: gguf

mmnga/mathstral-7B-v0.1-gguf

Updated about 3 hours ago

SubashNeupane/llama3-8b-heidi-notes-f16-gguf

Updated about 3 hours ago

Giudice7/llama3-8B-brick-v2

Updated about 3 hours ago

mradermacher/Mahou-1.3b-llama3-8B-i1-GGUF

Updated 12 minutes ago

SubashNeupane/gemma2-9b-SOAP_Heidi_notes-gguf

Updated about 2 hours ago

nullport/JackBot

Updated about 1 hour ago

RichardErkhov/tokyotech-llm_-_Swallow-70b-NVE-instruct-hf-gguf

Updated about 2 hours ago

ZeroWw/ghost-7b-alpha-GGUF

Updated about 2 hours ago

mradermacher/Llama-3-Groq-70B-Tool-Use-i1-GGUF

Updated 5 minutes ago

mradermacher/Llama-3-8B-Stroganoff-GGUF

Updated about 2 hours ago

townsag/email-one-thread-finetune-olive-gorge-28_gguf

Updated about 2 hours ago

mukel/Mathstral-7B-v0.1-GGUF

Updated 38 minutes ago

gsayak/Phi-3-mini-4k-instruct-Q8_0-GGUF

Text Generation • Updated about 2 hours ago

ZeroWw/Gemmasutra-9B-v1b-GGUF

Updated about 1 hour ago

RichardErkhov/varox34_-_Bio-Saul-Dolphin-Beagle-Breadcrumbs-gguf

Updated 2 minutes ago

alanrios2001/Phi-3-mini-4k-instruct-Q5_K_M-GGUF

Text Generation • Updated about 1 hour ago

plehrman24/Meta-Llama-3-8B-Q5_K_M-GGUF

Text Generation • Updated about 1 hour ago

ZeroWw/L3-8B-Celeste-v1-GGUF

Updated 27 minutes ago

twright8/gemmma_q8

Updated 19 minutes ago

BeaverAI/Gemmasutra-9B-v1c-GGUF

Updated 7 minutes ago