Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

42,874

Full-text search

Active filters: gguf

stephenlzc/Mistral-7B-v0.3-Chinese-Chat-uncensored

Text Generation • Updated Jun 25 • 3.73k • 3

cgus/NinjaMouse2-2.5B-v0.2-iMat-GGUF

Updated Jun 24 • 203 • 2

bartowski/llama-3-fantasy-writer-8b-GGUF

Text Generation • Updated Jun 24 • 5.24k • 3

mradermacher/Llama-3-70b-Arimas-story-RP-V2.1-GGUF

Updated Jul 2 • 301 • 2

Liquid1/llama-3-8b-liquid-coding-agent

Updated Jun 27 • 823 • 7

bartowski/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 15 • 30.2k • 181

QuantFactory/gemma-2-9b-GGUF

Text Generation • Updated Jun 29 • 1.6k • 5

second-state/gemma-2-27b-it-GGUF

Text Generation • Updated Jul 1 • 402 • 6

lmstudio-community/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 16 • 5.44k • 19

grapevine-AI/gemma-2-27b-it-gguf

Updated Aug 2 • 293 • 10

ZeroWw/gemma-2-9b-it-GGUF

Updated Jun 28 • 92 • 1

ManishThota/Ollama_Quantised_LLaVA-NeXT-Video-7B-DPO

Feature Extraction • Updated Jun 29 • 1.83k • 2

NorwAI/NorwAI-Mistral-7B-instruct

Text Generation • Updated Jul 8 • 135 • 5

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated 8 days ago • 1.18k • 18

bartowski/Gemma-2-9B-It-SPPO-Iter3-GGUF

Text Generation • Updated Jul 15 • 3.1k • 54

fbaldassarri/modello-italia-9B-GGUF

Text Generation • Updated Jul 3 • 308 • 1

DavidAU/Command-R-01-200xq-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • Updated Aug 16 • 118 • 11

joaquinito2073/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Jul 1 • 7 • 1

mmnga/Llama-3-Swallow-70B-Instruct-v0.1-gguf

Updated Jul 7 • 1.7k • 8

bartowski/Qwen2-7B-Multilingual-RP-GGUF

Text Generation • Updated Jul 1 • 15k • 7

mmnga/Llama-3-Swallow-8B-Instruct-v0.1-gguf

Updated Jul 2 • 927 • 3

shenzhi-wang/Gemma-2-27B-Chinese-Chat

Text Generation • Updated Jul 4 • 2.27k • 59

internlm/internlm2_5-7b-chat-gguf

Text Generation • Updated Jul 16 • 2.96k • 74

bartowski/Tess-v2.5-Gemma-2-27B-alpha-GGUF

Text Generation • Updated Jul 2 • 515 • 6

bartowski/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Aug 3 • 7.33k • 27

h2oai/h2o-danube3-500m-chat-GGUF

Text Generation • Updated Jul 4 • 1.67k • 16

Nafnlaus/Wide-Sheared-LLaMA-290M-GGUF

Updated Jul 4 • 296 • 1

stephenlzc/Gemma-2-9B-Chinese-Chat-Uncensored

Text Generation • Updated Jul 15 • 4.51k • 12

mradermacher/Llama3-UmbralMind-v1-15M-GGUF

Updated Jul 5 • 182 • 2

alibayram/DoktorGemma2-9b

Updated Jul 18 • 1 • 3