Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Misc with no match

Models

39,833

Full-text search

Active filters: gguf

mradermacher/mindspark-bot-v1-full-GGUF

Updated Jun 29 • 56

mradermacher/llama-3-8b-chat-srtip-v.1.3-GGUF

Updated Jun 29 • 39

bartowski/Fook-Yi-34B-32K-v1-GGUF

Text Generation • Updated Jun 29 • 7 • 1

mradermacher/llama-3-8b-samantha-i1-GGUF

Updated Aug 2 • 29

RichardErkhov/m-a-p_-_OpenCodeInterpreter-DS-1.3B-gguf

Updated Jun 29 • 127

mradermacher/Swallow-7b-NVE-instruct-hf-GGUF

Updated Jun 30 • 18

RichardErkhov/TechxGenus_-_CodeGemma-2b-gguf

Updated Jun 30 • 43

quixotedav/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Jun 29 • 8

NikolayKozloff/Viking-7B-Q8_0-GGUF

Updated Jun 29 • 6 • 1

BoscoTheDog/gemma_2b_sauerkraut_gguf_chunked

Text Generation • Updated Jul 22 • 27

NikolayKozloff/Viking-7B-Q6_K-GGUF

Updated Jun 29 • 1 • 1

mradermacher/Swallow-7b-NVE-hf-GGUF

Updated Jun 30 • 2

NikolayKozloff/Viking-7B-Q5_K_M-GGUF

Updated Jun 29 • 3 • 1

NikolayKozloff/Viking-7B-Q5_K_S-GGUF

Updated Jun 29 • 10 • 1

mradermacher/Med-LLaMA3-8B-GGUF

Updated Jun 29 • 210 • 2

mradermacher/Swallow-7b-hf-GGUF

Updated Jun 30 • 181

NikolayKozloff/Viking-7B-Q4_K_M-GGUF

Updated Jun 29 • 4 • 1

NikolayKozloff/Viking-7B-Q4_K_S-GGUF

Updated Jun 29 • 4 • 1

NikolayKozloff/Viking-7B-Q5_0-GGUF

Updated Jun 29 • 2 • 1

NikolayKozloff/Viking-7B-Q4_0-GGUF

Updated Jun 29 • 10 • 1

ManishThota/Ollama_VideoLLaMA2-7B

Updated Jun 29 • 315 • 1

mradermacher/mistral-11b-miniplatypus-GGUF

Updated Jun 29 • 4

mradermacher/llama3-70b-instruct-mmlu-college-medicine-af-mmlu-good-GGUF

Updated Jun 29 • 346 • 2

mradermacher/Swallow-7b-plus-hf-GGUF

Updated Jun 30 • 6

mradermacher/Med-LLaMA3-8B-i1-GGUF

Updated Aug 2 • 158

Daemontatox/zephq

Updated Jun 29 • 3

NikolayKozloff/gemma-2-9b-Q8_0-GGUF

Text Generation • Updated Jun 29 • 2 • 1

NikolayKozloff/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jun 29 • 2 • 1

RichardErkhov/moreh_-_MoMo-72B-lora-1.8.4-DPO-gguf

Updated Jun 30 • 30

NikolayKozloff/gemma-2-27b-Q3_K_S-GGUF

Text Generation • Updated Jun 29 • 16 • 1