Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

8-bit precision

Other with no match

4-bit precision

text-embeddings-inference

Models

2,797

Full-text search

Active filters: llama-cpp

hansmueller464/Llama3-Aloe-8B-Alpha-Q6_K-GGUF

Question Answering • Updated May 19 • 64

VlSav/saiga_llama3_8b-v4-Q6_K-GGUF

Updated May 19 • 36

ccarrez/meditron-7b-Q4_K_M-GGUF

Updated May 19 • 22

cminja/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 19 • 20

hansmueller464/Llama3-Aloe-8B-Alpha-Q8_0-GGUF

Question Answering • Updated May 19 • 54

cminja/Hebrew-Mistral-7B-Q4_K_M-GGUF

Updated May 19 • 20

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated May 19 • 38 • 1

VlSav/Hermes-2-Pro-Llama-3-8B-Q6_K-GGUF

Updated May 21 • 38

cleatherbury/phillama-3.8b-v0.1-Q4_K_M-GGUF

Text Generation • Updated May 19 • 19

kpkiosk66/LemonKunoichiWizardV3-Q6_K-GGUF

Updated May 19 • 18

cleatherbury/Mistroll-7B-v2.2-Q4_K_M-GGUF

Text Generation • Updated May 19 • 23

cleatherbury/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated May 19 • 40

GregorBiswanger/GritLM-7B-Q4_K_M-GGUF

Text Generation • Updated May 19 • 31

islamsaad/Phi-3-mini-128k-instruct-Q3_K_L-GGUF

Text Generation • Updated May 19 • 16

NikolayKozloff/SambaLingo-Slovenian-Chat-Q4_K_M-GGUF

Updated May 19 • 24 • 1

mayank-mishra/granite-20b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 19 • 23

NikolayKozloff/tyr-Q8_0-GGUF

Text Generation • Updated May 19 • 18 • 1

NikolayKozloff/Falcon2-5.5B-Dutch-Q4_0-GGUF

Updated May 19 • 136 • 1

NikolayKozloff/Llama-3-8b-ita-ties-Q8_0-GGUF

Updated May 19 • 37 • 1

mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF

Updated May 19 • 48 • 1

cleatherbury/Phi-3-mini-4k-instruct-Q4_0-GGUF

Text Generation • Updated May 19 • 68

cminja/Phi-3-mini-128k-instruct-Q2_K-GGUF

Text Generation • Updated May 20 • 22

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q8_0-GGUF

Text Generation • Updated May 20 • 55

HyunCello/EEVE-Korean-Instruct-10.8B-v1.0-test-0.1-Q4_K_M-GGUF

Updated May 20 • 24

leafspark/Yi-1.5-34B-Chat-16K-Q4_K_M-GGUF

Updated May 20 • 29

Cran-May/firefly-qwen1.5-en-14b-alpha-Q4_K_M-GGUF

Updated May 20 • 40

leafspark/Yi-1.5-34B-Chat-16K-Q8_0-GGUF

Updated May 20 • 26

smcleod/Yi-1.5-34B-Chat-16K-Q5_K_M-GGUF

Updated May 20 • 22

junkiahn/T3Q-ko-solar-dpo-v7.0-Q5_K_M-GGUF

Updated May 20 • 20

leafspark/Yi-1.5-34B-Chat-16K-Q3_K_M-GGUF

Updated May 20 • 25 • 2