Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

3,922

Full-text search

Active filters: llama-cpp

cminja/vicuna-13b-v1.5-Q4_K_M-GGUF

Updated May 19 • 9

NikolayKozloff/Master-Yi-9B-Q4_0-GGUF

Updated May 19 • 19 • 1

hansmueller464/Llama3-Aloe-8B-Alpha-Q6_K-GGUF

Question Answering • Updated May 19 • 25

cminja/Llama-3-8B-Lexi-Uncensored-Q8_0-GGUF

Updated May 19 • 20 • 1

ccarrez/meditron-7b-Q4_K_M-GGUF

Updated May 19 • 7

cminja/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 19 • 8

hansmueller464/Llama3-Aloe-8B-Alpha-Q8_0-GGUF

Question Answering • Updated May 19 • 29

cminja/Hebrew-Mistral-7B-Q4_K_M-GGUF

Updated May 19 • 11

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated May 19 • 13 • 1

VlSav/Hermes-2-Pro-Llama-3-8B-Q6_K-GGUF

Updated May 21 • 14

kpkiosk66/LemonKunoichiWizardV3-Q6_K-GGUF

Updated May 19 • 9

cleatherbury/Llama-3-8B-Instruct-Gradient-1048k-Q4_K_M-GGUF

Text Generation • Updated May 19 • 12

GregorBiswanger/GritLM-7B-Q4_K_M-GGUF

Text Generation • Updated May 19 • 7

islamsaad/Phi-3-mini-128k-instruct-Q3_K_L-GGUF

Text Generation • Updated May 19 • 11

NikolayKozloff/SambaLingo-Slovenian-Chat-Q4_K_M-GGUF

Updated May 19 • 7 • 1

mayank-mishra/granite-20b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 19 • 13

NikolayKozloff/tyr-Q8_0-GGUF

Text Generation • Updated May 19 • 9 • 1

NikolayKozloff/Falcon2-5.5B-Dutch-Q4_0-GGUF

Updated May 19 • 101 • 1

NikolayKozloff/Llama-3-8b-ita-ties-Q8_0-GGUF

Updated May 19 • 13 • 1

mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF

Updated May 19 • 16 • 1

cminja/Phi-3-mini-128k-instruct-Q2_K-GGUF

Text Generation • Updated May 20 • 13

cminja/Llama-3-8B-Instruct-Gradient-1048k-Q8_0-GGUF

Text Generation • Updated May 20 • 16

HyunCello/EEVE-Korean-Instruct-10.8B-v1.0-test-0.1-Q4_K_M-GGUF

Updated May 20 • 9

leafspark/Yi-1.5-34B-Chat-16K-Q4_K_M-GGUF

Updated May 20 • 158

Cran-May/firefly-qwen1.5-en-14b-alpha-Q4_K_M-GGUF

Updated May 20 • 14

leafspark/Yi-1.5-34B-Chat-16K-Q8_0-GGUF

Updated May 20 • 423

smcleod/Yi-1.5-34B-Chat-16K-Q5_K_M-GGUF

Updated May 20 • 8

junkiahn/T3Q-ko-solar-dpo-v7.0-Q5_K_M-GGUF

Updated May 20 • 8

leafspark/Yi-1.5-34B-Chat-16K-Q3_K_M-GGUF

Updated May 20 • 350 • 2

NikolayKozloff/Yi-1.5-9B-Chat-16K-Q8_0-GGUF

Updated May 20 • 11 • 1