Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

8-bit precision

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

Models

2,672

Full-text search

Active filters: llama-cpp

DavidAU/D_AU-Multi-Verse-RP-Yarn-Mistral-7b-128k-DPO-Q4_K_M-GGUF

Updated Apr 30 • 365

Clevyby/Karen_TheEditor_V2_CREATIVE_Mistral_7B-Q5_K_S-GGUF

Updated May 2 • 24

Clevyby/Karen_TheEditor_V2_STRICT_Mistral_7B-Q5_K_S-GGUF

Updated May 2 • 23

naskimed/BugsPredv3.1-Q8_0-GGUF

Updated Apr 30 • 24

reach-vb/Meta-Llama-3-8B-Q4_0-GGUF

Text Generation • Updated Apr 30 • 53

itayl/dictalm2.0-instruct-Q5_K_M-GGUF

Text Generation • Updated Apr 30 • 23

itayl/dictalm2.0-instruct-Q2_K-GGUF

Text Generation • Updated Apr 30 • 22

int2eh/deepseek-coder-6.7b-instruct-Q6_K-GGUF

Updated Apr 30 • 19

int2eh/deepseek-coder-33b-instruct-Q5_K_S-GGUF

Updated Apr 30 • 16

tushar310/Phi-3-mini-128k-instruct-Q4_0-GGUF

Text Generation • Updated Apr 30 • 65

jayrodge/Llama3-3-8B-Instruct-ft-loraAdap-Q4_K_M-GGUF

Updated Apr 30 • 45 • 1

cleatherbury/CatPPT-base-Q5_K_M-GGUF

Updated Apr 30 • 20

gagagiga/Llama-3-MAAL-8B-Instruct-v0.1-Q4_K_S-GGUF

Updated May 1 • 45

gagagiga/Llama-3-MAAL-8B-Instruct-v0.1-Q8_0-GGUF

Updated May 1 • 45

gagagiga/Llama-3-MAAL-8B-Instruct-v0.1-Q5_K_M-GGUF

Updated May 1 • 66

gagagiga/Llama-3-MAAL-8B-Instruct-v0.1-Q4_K_M-GGUF

Updated May 1 • 47

gagagiga/Llama-3-Open-Ko-8B-Q4_K_M-GGUF

Text Generation • Updated May 1 • 42

existmaster/Llama-3-8B-Instruct-Gradient-1048k-Q8_0-GGUF

Text Generation • Updated May 1 • 43 • 1

LakoMoor/Vikhr-7B-instruct_0.4-Q5_K_M-GGUF

Updated May 1 • 31

Cali9994/phi-3.8-128k-italian-Q4_K_M-GGUF

Updated May 1 • 19

cleatherbury/rocket-3B-Q6_K-GGUF

Updated May 1 • 23

LeroyDyer/Mixtral_AI_NFSW_001

Updated May 2 • 37 • 1

Vikhrmodels/Vikhr-7B-instruct_0.4-GGUF

Updated May 5 • 1.82k • 7

hus960/Scarlett-Llama-3-8B-v1.0-Q4_K_M-GGUF

Updated May 1 • 39

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q5_K_M-GGUF-PTBR

Text Generation • Updated May 1 • 30

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF-PTBR

Text Generation • Updated May 1 • 24

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_0-GGUF-PTBR

Text Generation • Updated May 1 • 82

joeshmoethefunnyone/pythia-410m-Q4_K_M-GGUF

Updated May 2 • 28

joeshmoethefunnyone/pythia-410m-Q3_K_M-GGUF

Updated May 2 • 27

igorbkz/Phi-3-mini-128k-instruct-Q4_0-GGUF

Text Generation • Updated May 2 • 60