Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Misc with no match

Models

35,746

Full-text search

Active filters: gguf

Jaidchen/Llama3-DiscoLeo-Instruct-8B-32k-v0.1-IQ4_NL-GGUF

Updated Jun 20 • 14

QuantFactory/Llama-3-8B-Tulu-330K-GGUF

Text Generation • Updated Jun 20 • 176 • 1

QuantFactory/st-vicuna-v1.3-10.5b-taylor-GGUF

Text Generation • Updated Jun 20 • 95

mradermacher/L3-8B-Stheno-2x8B-MoE-i1-GGUF

Updated Aug 2 • 209 • 1

Klevin/PRIME-DeCyphers-Final-Q2_K-GGUF

Updated Jun 20 • 9 • 1

RichardErkhov/AIGym_-_deepseek-coder-6.7b-chat-gguf

Updated Jun 20 • 261 • 1

Jaidchen/Llama3-German-8B-32k-Q8_0-GGUF

Updated Jun 20 • 17

Kitajiang/push_exam2-Q4_K_M-GGUF

Updated Jun 20 • 8

Anishproshort/llama3_ft

Text Generation • Updated Jun 20 • 11

RichardErkhov/InferenceIllusionist_-_Magic-Dolphin-7b-gguf

Updated Jun 20 • 158 • 2

QuantFactory/st-vicuna-v1.3-10.5b-ppl-GGUF

Text Generation • Updated Jun 20 • 212 • 1

RichardErkhov/CorticalStack_-_pastiche-crown-clown-7b-dare-gguf

Updated Jun 20 • 143 • 1

oldflag/symptom_dx_finetue_Llama-3_8b_Unsloth_GGUF

Updated Jun 20 • 11 • 1

QuantFactory/Llama-3-8B-WildChat-GGUF

Text Generation • Updated Jun 20 • 158 • 1

RichardErkhov/Locutusque_-_OpenCerebrum-1.5-Mistral-7B-v0.2-beta-gguf

Updated Jun 20 • 170 • 1

V3N0M/Jenna-Uncensored-GGUF-q4-v02

Updated Jun 20 • 629 • 1

vvrules00/llama-3-8b-Instruct-bnb-4bit-aiaustin-demo

Updated Jun 20 • 28

RichardErkhov/Gille_-_StrangeMerges_12-7B-slerp-gguf

Updated Jun 20 • 113 • 1

V3N0M/Jenna-Uncensored-GGUF-v02

Updated Jun 20 • 48 • 2

V3N0M/Jenna-Unensored-GGUF-16-v2

Updated Jun 20 • 36 • 1

hoschidude/sqlcoder-70-alpha-q4_k_m.gguf

Updated Jun 20 • 5 • 1

duyntnet/Maika-Buddy-3B8-Phi3-imatrix-GGUF

Text Generation • Updated Jun 20 • 209 • 1

xX-FANE-Xx/RAFT-mistral-v1-merged-Q5_K_M-GGUF

Updated Jun 20 • 21 • 1

Klevin/J.A.R.V.I.S-v2.0-Q4_K_M-GGUF

Updated Jun 20 • 11 • 2

chahn85/LLAMA-3-8B-OPTN-gguf

Updated Jun 20 • 14 • 1

QuantFactory/llama-3-zilo-sql-GGUF

Text Generation • Updated Jun 20 • 297 • 1

hyhf/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 20 • 3 • 1

grapevine-AI/Meta-Llama-3-70B-Instruct-GGUF

Updated Jun 22 • 104 • 1

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20 • 599 • 3

ravindrakinagi/phi3_mini

Updated Jun 20 • 58