Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

Models

18,050

Full-text search

Active filters: gguf

RichardErkhov/yanolja_-_EEVE-Korean-10.8B-v1.0-gguf

Updated May 2 • 445 • 1

YorkieOH10/phi-3-on-mac-Q8_0-GGUF

Text Generation • Updated May 2 • 20

YorkieOH10/phi-3-on-mac-Q6_K-GGUF

Text Generation • Updated May 2 • 18

YorkieOH10/phi-3-on-mac-Q5_K_M-GGUF

Text Generation • Updated May 2 • 18

YorkieOH10/phi-3-on-mac-Q5_K_S-GGUF

Text Generation • Updated May 2 • 17

YorkieOH10/phi-3-on-mac-Q5_0-GGUF

Text Generation • Updated May 2 • 20

YorkieOH10/phi-3-on-mac-Q4_K_M-GGUF

Text Generation • Updated May 2 • 17

YorkieOH10/phi-3-on-mac-Q4_K_S-GGUF

Text Generation • Updated May 2 • 20

YorkieOH10/phi-3-on-mac-Q4_0-GGUF

Text Generation • Updated May 2 • 41

YorkieOH10/phi-3-on-mac-Q3_K_L-GGUF

Text Generation • Updated May 2 • 17

VXAnh/Vistral-7B-Chat-20k-gguf

Updated May 2 • 19

YorkieOH10/phi-3-on-mac-Q3_K_M-GGUF

Text Generation • Updated May 2 • 19

YorkieOH10/phi-3-on-mac-Q3_K_S-GGUF

Text Generation • Updated May 2 • 20

YorkieOH10/phi-3-on-mac-Q2_K-GGUF

Text Generation • Updated May 2 • 17

jurieyel/text2sql-tinyllama-4bit-gguf-q4_K_m

Updated May 2 • 23

Parssky/Llama3-8B-TechnicalReport-bf16_GGUF

Updated May 2 • 59

julicq/model-q4_K

Updated May 2 • 19

RichardErkhov/Andron00e_-_YetAnother_Open-Llama-3B-LoRA-OpenOrca-gguf

Updated May 2 • 529 • 1

PrunaAI/MathCoder-CL-7B-GGUF-smashed

Updated May 2 • 378

mradermacher/llama-2-16b-nastychat-i1-GGUF

Updated May 5 • 166

mradermacher/Meta-Llama-3-8B-VIGGO-GGUF

Updated May 5 • 167

mradermacher/TemptressTensor-10.7B-v0.1a-GGUF

Updated May 5 • 81

mradermacher/Tiamat-8b-1.2-Llama-3-DPO-GGUF

Updated May 5 • 162

bakkensus/phi-2-all-at-once-gguf

Updated May 2 • 21

mradermacher/Llama3-Unholy-8B-OAS-GGUF

Updated May 5 • 225

mradermacher/LancarAI-v1.0-GGUF

Updated May 5 • 112

mradermacher/Configurable-Hermes-2-Pro-Llama-3-8B-GGUF

Updated May 5 • 526 • 1

mradermacher/Llama-3-11b-Instruct-GGUF

Updated May 5 • 131 • 1

NikolayKozloff/Boreas-7B-Q8_0-GGUF

Updated May 2 • 18 • 1

RichardErkhov/Felladrin_-_Llama-68M-Chat-v1-gguf

Updated May 2 • 144