Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

Models

18,062

Full-text search

Active filters: gguf

openbmb/MiniCPM-Llama3-V-2_5-gguf

Updated 4 days ago • 51.4k • 148

Qwen/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 2 days ago • 8.54k • 42

bartowski/Codestral-22B-v0.1-GGUF

Text Generation • Updated 3 days ago • 30.7k • 114

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated 2 days ago • 4.71k • 29

mixedbread-ai/mxbai-embed-large-v1

Feature Extraction • Updated Apr 18 • 1.57M • 372

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated 2 days ago • 3.54k • 18

google/gemma-2b

Text Generation • Updated Apr 16 • 361k • 748

cognitivecomputations/dolphin-2.9.2-qwen2-7b-gguf

Text Generation • Updated 2 days ago • 1.43k • 14

google/gemma-7b

Text Generation • Updated May 1 • 203k • 2.93k

bartowski/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 2 days ago • 5.53k • 13

Orenguteng/Llama-3-8B-Lexi-Uncensored-GGUF

Updated Apr 23 • 55.2k • 77

google/gemma-2b-it

Text Generation • Updated Apr 16 • 155k • 547

vikhyatk/moondream2

Image-Text-to-Text • Updated 17 days ago • 76.1k • 453

microsoft/Phi-3-mini-4k-instruct-gguf

Text Generation • Updated Apr 22 • 72.8k • 367

NorwAI/NorwAI-Mistral-7B-instruct

Text Generation • Updated 1 day ago • 349 • 11

NorwAI/NorwAI-Mixtral-8x7B-instruct

Text Generation • Updated 1 day ago • 128 • 11

redponike/AutoCoder-GGUF

Updated 23 days ago • 312 • 11

hfl/llama-3-chinese-8b-instruct-v3-gguf

Updated 3 days ago • 8.52k • 19

QuantFactory/NeuralDaredevil-8B-abliterated-GGUF

Text Generation • Updated 10 days ago • 3.36k • 15

xtuner/llava-llama-3-8b-v1_1-gguf

Image-to-Text • Updated Apr 30 • 21.5k • 113

cognitivecomputations/dolphin-2.9.2-qwen2-72b-gguf

Updated 11 days ago • 2.46k • 10

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated 6 days ago • 1.52k • 9

bartowski/Phi-3-medium-128k-instruct-GGUF

Text Generation • Updated 18 days ago • 23.7k • 36

google/madlad400-10b-mt

Translation • Updated Apr 12 • 6.72k • 57

NorwAI/NorwAI-Mistral-7B

Text Generation • Updated 1 day ago • 505 • 6

shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-8bit

Text Generation • Updated 13 days ago • 65.2k • 127

bartowski/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 29 • 17.1k • 60

bartowski/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Text Generation • Updated May 4 • 503k • 13

NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF

Updated 25 days ago • 14.4k • 65

OEvortex/HelpingAI-9B

Text Generation • Updated 10 days ago • 1.29k • 15