Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

Models

16,832

Full-text search

Active filters: gguf

duyntnet/phillama-3.8b-v1-imatrix-GGUF

Text Generation • Updated about 1 month ago • 6.17k

mradermacher/NyakuraV2-34B-Yi-Llama-GGUF

Updated 27 days ago • 561

backyardai/Phi-3-mini-4k-instruct-GGUF

Text Generation • Updated 10 days ago • 5.32k

mradermacher/BigMaid-20B-v1.0-GGUF

Updated 27 days ago • 15.2k • 3

vkrishnan569/tinyllama_4Q

Updated about 1 month ago • 159

jsfs11/TemptressTensor-10.7B-v0.1a-GGUF

Updated about 1 month ago • 465

LoupGarou/deepseek-coder-6.7b-instruct-pythagora-v2-gguf

Updated 26 days ago • 3.83k

mradermacher/CarbonVillain-v4-Sakura-Solar-Slerp-GGUF

Updated 27 days ago • 650

airbus5717/Mixtral-8x7b-v0.1-cybered

Updated 24 days ago • 6

kloodia/llama3-8x8-q_8

Updated about 1 month ago • 44

duyntnet/OpenHermes-2.5-Mistral-7B-imatrix-GGUF

Text Generation • Updated about 1 month ago • 6.91k

justinj92/phi3-orpo-Q4_K_M-GGUF

Updated about 1 month ago • 258

Falah/gemma-medical_qa-GGUF

Updated about 1 month ago • 218

LeroyDyer/Mixtral_AI_CyberFriend_1.0_GGUF

Updated about 1 month ago • 26

CarlosFersoft/GPBusiness0001_Q8

Updated about 1 month ago • 64

Undi95/Llama3-Unholy-8B-OAS-GGUF

Updated about 1 month ago • 1.15k • 9

dddump/Japanese-Chat-Evolve-TEST-7B-NSFW-gguf

Text Generation • Updated 15 days ago • 2.34k • 14

Trisert/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated about 1 month ago • 40

RichardErkhov/lgodwangl_-_new_01m-gguf

Updated about 1 month ago • 4.85k

YorkieOH10/phi-3-on-mac-Q8_0-GGUF

Text Generation • Updated about 1 month ago • 404

YorkieOH10/phi-3-on-mac-Q6_K-GGUF

Text Generation • Updated about 1 month ago • 316

YorkieOH10/phi-3-on-mac-Q5_K_M-GGUF

Text Generation • Updated about 1 month ago • 285

YorkieOH10/phi-3-on-mac-Q5_K_S-GGUF

Text Generation • Updated about 1 month ago • 267

YorkieOH10/phi-3-on-mac-Q5_0-GGUF

Text Generation • Updated about 1 month ago • 270

YorkieOH10/phi-3-on-mac-Q4_K_M-GGUF

Text Generation • Updated about 1 month ago • 244

YorkieOH10/phi-3-on-mac-Q4_K_S-GGUF

Text Generation • Updated about 1 month ago • 231

YorkieOH10/phi-3-on-mac-Q4_0-GGUF

Text Generation • Updated about 1 month ago • 245

YorkieOH10/phi-3-on-mac-Q3_K_L-GGUF

Text Generation • Updated about 1 month ago • 218

VXAnh/Vistral-7B-Chat-20k-gguf

Updated about 1 month ago • 22

YorkieOH10/phi-3-on-mac-Q3_K_M-GGUF

Text Generation • Updated about 1 month ago • 208