Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Other with no match

Models

19,516

Full-text search

Active filters: gguf

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4 • 2.47k • 37

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 4.74k • 108

lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated May 3 • 96.1k • 159

instructlab/merlinite-7b-lab-GGUF

Updated Apr 19 • 7.07k • 11

QuantFactory/dolphin-2.9-llama3-8b-GGUF

Text Generation • Updated 11 days ago • 10.1k • 39

shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-f16

Text Generation • Updated 24 days ago • 36.1k • 24

QuantFactory/Phi-3-mini-128k-instruct-GGUF

Text Generation • Updated 26 days ago • 15.9k • 31

llmware/bling-phi-3-gguf

Updated May 2 • 570 • 11

mradermacher/Mistral-DPO-Uncensored-GGUF

Updated May 5 • 834 • 2

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25 • 21.3k • 12

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 2 • 8.52k • 38

QuantFactory/Meta-Llama-3-8B-Instruct-GGUF-v2

Text Generation • Updated May 6 • 3.74k • 9

Lewdiculous/Poppy_Porpoise-0.72-L3-8B-GGUF-IQ-Imatrix

Updated May 19 • 4.8k • 24

failspy/Llama-3-70B-Instruct-abliterated-v3-GGUF

Updated 22 days ago • 1k • 14

bartowski/llama-3-sqlcoder-8b-GGUF

Text Generation • Updated 30 days ago • 5.67k • 2

bartowski/Phi-3-medium-128k-instruct-GGUF

Text Generation • Updated 29 days ago • 29.7k • 39

fearlessdots/WizardLM-2-7B-abliterated-GGUF

Updated 27 days ago • 653 • 7

mlabonne/Daredevil-8B-abliterated-GGUF

Updated 24 days ago • 216 • 6

failspy/Phi-3-mini-128k-instruct-abliterated-v3-GGUF

Updated 24 days ago • 2.8k • 7

NovNovikov/SOLAR-10.7B-Instruct-v1.0-uncensored-Q6_K-GGUF

Updated 24 days ago • 226 • 2

hfl/llama-3-chinese-8b-instruct-v3-gguf

Updated 14 days ago • 12k • 21

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated 17 days ago • 3.78k • 16

vinci00/llama-3-8b-Instruct-bnb-4bit-scrapegraph-companion

Updated 2 days ago • 101 • 5

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated 17 days ago • 2.24k • 12

failspy/Codestral-22B-v0.1-abliterated-v3-GGUF

Updated 16 days ago • 1.98k • 6

bartowski/Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation • Updated 14 days ago • 1.13k • 8

legraphista/Higgs-Llama-3-70B-IMat-GGUF

Text Generation • Updated 13 days ago • 1.82k • 6

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 13 days ago • 194k • 7

mradermacher/L3-Aethora-15B-GGUF

Updated 12 days ago • 1.11k • 5

bartowski/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated 12 days ago • 813 • 2