Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

8,517

Full-text search

Active filters: llama-cpp

ClaudioItaly/TopEvolutionWiz-Q8_0-GGUF

Updated Aug 13 • 7

AlirezaF138/Dorna-Llama3-8B-Instruct-GGUF

Updated Jun 8 • 45 • 1

tihuang/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 8 • 31

NikolayKozloff/Llama-3-8B-Swedish-Norwegian-Danish-checkpoint-14375-08_06_2024-Q8_0-GGUF

Text Generation • Updated Jun 9 • 8 • 1

2sy1227/gemma-7b-ko-sum-Q4_K_M-GGUF

zachaman/phi3-goodwater5-merged-Q4_0-GGUF

Updated Jun 9 • 24

rhudock/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jun 9 • 3

NikolayKozloff/GeM2-Llamion-14B-LongChat-Q4_0-GGUF

Updated Jun 9 • 12 • 1

NikolayKozloff/Irbis-7b-v0.1-Kazakh-Q8_0-GGUF

Text Generation • Updated Jun 9 • 9 • 2

NikolayKozloff/GeM2-Llamion-14B-LongChat-Q5_0-GGUF

Updated Jun 9 • 3 • 1

NikolayKozloff/Qwen2-7B-Instruct-deccp-Q8_0-GGUF

Updated Jun 10 • 6 • 1

lamptablet/gpt2-Q8_0-GGUF

Updated Jun 9 • 11

NikolayKozloff/GeM2-Llamion-14B-Chat-Q5_K_M-GGUF

Updated Jun 9 • 1 • 1

NikolayKozloff/GeM2-Llamion-14B-Chat-Q5_K_S-GGUF

Updated Jun 9 • 4 • 1

NikolayKozloff/GeM2-Llamion-14B-Chat-Q4_K_M-GGUF

Updated Jun 9 • 2 • 1

NikolayKozloff/GeM2-Llamion-14B-Base-Q4_K_M-GGUF

Updated Jun 9 • 1 • 1

taoofstefan/llama2-7B-MT-FT-llama2-S-v0.3-Q4_K_M-GGUF

Updated Jun 9 • 1

powermove72/Trinity_Notus-xb-Q4_K_M-GGUF

Updated Jun 9 • 6 • 1

taoofstefan/mistral-7B-MT-FT-Mistral-S-Q4_K_M-GGUF

sydonayrex/Barely-Regal-10.7B-DPO-Q8_0-GGUF

Updated Jun 10 • 6

v8karlo/dolphin-2.9.2-qwen2-7b-Q5_K_M-GGUF

Updated Jun 10 • 19 • 1

sydonayrex/Barely-Regal-10.7B-DPO-Q6_K-GGUF

Updated Jun 10 • 1

sydonayrex/Barely-Regal-10.7B-DPO-Q4_K_M-GGUF

Updated Jun 10 • 8

kowlick/Qwen2-7B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jun 10 • 1

kowlick/Qwen2-72B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jun 10 • 18

lykong-fdu/Meta-Llama-3-70B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 10 • 7

win10/llama3-13.45b-Instruct-Q6_K-GGUF

Text Generation • Updated Jun 10 • 3

morrissas/TAIDE-LX-7B-Chat-Q4_K_M-GGUF

Updated Jun 10 • 10

win10/llama3-13.45b-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 10 • 3

morrissas/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • Updated Jul 24 • 1