Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

2,603

Full-text search

Active filters: gguf-my-repo

cminja/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 19 • 19

cminja/vicuna-13b-v1.5-Q4_K_M-GGUF

Updated May 19 • 33

NikolayKozloff/Master-Yi-9B-Q4_0-GGUF

Updated May 19 • 42 • 1

hansmueller464/Llama3-Aloe-8B-Alpha-Q6_K-GGUF

Question Answering • Updated May 19 • 82

VlSav/saiga_llama3_8b-v4-Q6_K-GGUF

Updated May 19 • 49

ccarrez/meditron-7b-Q4_K_M-GGUF

Updated May 19 • 25

cminja/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 19 • 24

hansmueller464/Llama3-Aloe-8B-Alpha-Q8_0-GGUF

Question Answering • Updated May 19 • 65

cminja/Hebrew-Mistral-7B-Q4_K_M-GGUF

Updated May 19 • 26

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated May 19 • 47 • 1

VlSav/Hermes-2-Pro-Llama-3-8B-Q6_K-GGUF

Updated May 21 • 52

cleatherbury/phillama-3.8b-v0.1-Q4_K_M-GGUF

Text Generation • Updated May 19 • 26

kpkiosk66/LemonKunoichiWizardV3-Q6_K-GGUF

Updated May 19 • 22

cleatherbury/Mistroll-7B-v2.2-Q4_K_M-GGUF

Text Generation • Updated May 19 • 32

cleatherbury/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated May 19 • 49

GregorBiswanger/GritLM-7B-Q4_K_M-GGUF

Text Generation • Updated May 19 • 37

islamsaad/Phi-3-mini-128k-instruct-Q3_K_L-GGUF

Text Generation • Updated May 19 • 21

NikolayKozloff/SambaLingo-Slovenian-Chat-Q4_K_M-GGUF

Updated May 19 • 31 • 1

aetherwiing/L3-Zodiac-8B-ORPO-Base-Q8_0-GGUF

Updated May 19 • 53

mayank-mishra/granite-20b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 19 • 32

NikolayKozloff/tyr-Q8_0-GGUF

Text Generation • Updated May 19 • 22 • 1

NikolayKozloff/Falcon2-5.5B-Dutch-Q4_0-GGUF

Updated May 19 • 146 • 1

NikolayKozloff/Llama-3-8b-ita-ties-Q8_0-GGUF

Updated May 19 • 49 • 1

mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF

Updated May 19 • 63 • 1

cleatherbury/Phi-3-mini-4k-instruct-Q4_0-GGUF

Text Generation • Updated May 19 • 71

cminja/Phi-3-mini-128k-instruct-Q2_K-GGUF

Text Generation • Updated May 20 • 26

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q8_0-GGUF

Text Generation • Updated May 20 • 65

HyunCello/EEVE-Korean-Instruct-10.8B-v1.0-test-0.1-Q4_K_M-GGUF

Updated May 20 • 35

leafspark/Yi-1.5-34B-Chat-16K-Q4_K_M-GGUF

Updated May 20 • 35

Cran-May/firefly-qwen1.5-en-14b-alpha-Q4_K_M-GGUF

Updated May 20 • 46