Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

7,158

Full-text search

Active filters: llama-cpp

KingsonHO/Meta-Llama-3-8B-Instruct-Q5_0-GGUF

Text Generation • Updated May 23 • 9

nadeem1362/mxbai-embed-large-v1-Q4_K_M-GGUF

Feature Extraction • Updated May 23 • 12

YorkieOH10/Cream-Phi-3-14B-v1-Q8_0-GGUF

Updated May 23 • 10 • 1

ArturoVitale/gpt2-Q2_K-GGUF

Updated May 23 • 26

gimling/Qwen1.5-14B-Chat-Q4_0-GGUF

Text Generation • Updated May 23 • 56

AdeepH/Meta-Llama-3-8B-Q5_0-GGUF

Text Generation • Updated May 23 • 27

KKdu/MEDOVUCHA-gpt2-Q4_K_M-GGUF

Updated May 23 • 15

KKdu/MEDOVUCHA-gpt2-Q8_0-GGUF

Updated May 23 • 16

cleatherbury/TinyDolphin-2.8-1.1b-Q4_K_M-GGUF

Updated May 24 • 14

iggym/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 24 • 7

behnamoh/Phi-3-medium-4k-instruct-Q4_0-GGUF

Text Generation • Updated May 24 • 33 • 1

nanowell/Artigenz-Coder-DS-6.7B-Q4_K_M-GGUF

Updated May 24 • 21

wwe180/Llama3-15B-ShenNu-v0.1-Q6_K-GGUF

Updated May 24 • 37

tekiny/Mistral-7B-v0.1-Q4_K_M-GGUF

Text Generation • Updated May 24 • 36

Synec801/hermes-2-pro-llama3-entity-mapping-Q8_0-GGUF

Updated May 24 • 37

NikolayKozloff/openchat-3.6-8b-20240522-Q8_0-GGUF

Text Generation • Updated May 25 • 18 • 1

gate369/teslav0-Q8_0-GGUF

Updated May 25 • 13

skyxiaobaibai/Qwen1.5-1.8B-Chat-Q2_K-GGUF

Text Generation • Updated May 25 • 27

ElMater06/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 25 • 10

sth4nth/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 25 • 6

AIRider/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 30 • 7 • 1

springwater/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 25 • 5

song7/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 25 • 17

noxinc/portuguese-Phi3-Tom-Cat-128k-instruct-Q5_K_M-GGUF

Text Generation • Updated May 25 • 17

danielus/Mermaid-Phi-3-medium-128k-instruct-14B-Q8_0-GGUF

Updated May 25 • 17

danielus/Mermaid-Phi-3-medium-128k-instruct-14B-Q6_K-GGUF

Updated May 25 • 18

joshnader/Mistral-7B-Instruct-v0.2-Q5_K_M-GGUF

Text Generation • Updated May 25 • 14

Cran-May/blossom-v3_1-baichuan2-13b-Q4_K_M-GGUF

Text Generation • Updated May 25 • 17

SourPineapple/Llama-3-Alpha-Ko-8B-Instruct-Q5_K_M-GGUF

Updated May 25 • 30

YorkieOH10/CodeLlama-7B-Kexer-Q8_0-GGUF

Updated May 25 • 27