Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Other with no match

Models

19,420

Full-text search

Active filters: gguf

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25 • 26.9k • 12

mradermacher/Noromaid-13B-0.4-DPO-i1-GGUF

Updated May 5 • 474 • 2

crusoeai/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Updated May 5 • 9.61k • 67

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 2 • 8.47k • 38

Lewdiculous/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF-IQ-Imatrix

Updated May 12 • 15.4k • 45

failspy/Llama-3-70B-Instruct-abliterated-v3-GGUF

Updated 21 days ago • 984 • 14

bartowski/llama-3-sqlcoder-8b-GGUF

Text Generation • Updated 29 days ago • 5.6k • 2

lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 27 days ago • 5.08k • 18

legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF

Text Generation • Updated 23 days ago • 2.64k • 4

mlabonne/Daredevil-8B-abliterated-GGUF

Updated 23 days ago • 202 • 6

failspy/Phi-3-mini-128k-instruct-abliterated-v3-GGUF

Updated 23 days ago • 2.7k • 7

NovNovikov/SOLAR-10.7B-Instruct-v1.0-uncensored-Q6_K-GGUF

Updated 23 days ago • 211 • 2

bartowski/Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation • Updated 13 days ago • 1.06k • 8

legraphista/Higgs-Llama-3-70B-IMat-GGUF

Text Generation • Updated 12 days ago • 1.6k • 6

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 12 days ago • 170k • 7

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • Updated 12 days ago • 7.23k • 7

rAIfle/bagel-jamba-v05-gguf

Updated 11 days ago • 40 • 1

mradermacher/L3-Aethora-15B-GGUF

Updated 11 days ago • 1.08k • 5

mradermacher/L3-Aethora-15B-i1-GGUF

Updated 11 days ago • 1.86k • 4

QuantFactory/dolphin-2.9.2-qwen2-7b-GGUF

Text Generation • Updated 11 days ago • 1.89k • 3

mradermacher/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-i1-GGUF

Updated 9 days ago • 561 • 2

mradermacher/Nous-Hermes-2-Mixtral-8x7B-DPO-i1-GGUF

Updated 9 days ago • 1.56k • 3

mradermacher/L3-SthenoMaidBlackroot-8B-V1-GGUF

Updated 9 days ago • 3.22k • 3

DrChamyoung/PartnerAI

Updated 9 days ago • 38 • 2

Oblivionus/LLaMa-3-Stheno-v3.2-15B-Q6_K-GGUF

Updated 9 days ago • 102 • 2

bartowski/badger-lambda-llama-3-8b-GGUF

Text Generation • Updated 7 days ago • 3.32k • 3

natekoenig/phi-3-vision-gguf

Text Generation • Updated 7 days ago • 1.08k • 1

Lewdiculous/llama3-8B-aifeifei-1.3-GGUF-IQ-Imatrix

Updated 7 days ago • 1.55k • 2

DrChamyoung/Quinbeta1.1

Updated 7 days ago • 372 • 2

raincandy-u/TinyStories-656K-Q8_0-GGUF

Updated 7 days ago • 5 • 2