Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

7,156

Full-text search

Active filters: llama-cpp

wwe180/Phi-3-medium-128k-10B-lingyang-v0.1-Q6_K-GGUF

Updated May 21 • 13

int2eh/Phi-3-medium-128k-instruct-Q5_K_M-GGUF

Text Generation • Updated May 21 • 7

e2jhiubyiiyvw/Phi-3-medium-128k-instruct-Q5_K_M-GGUF

Text Generation • Updated May 22 • 21

aayushg159/Phi-3-medium-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 22 • 13

farpluto/Phi-3-medium-4k-instruct-Q4_K_S-GGUF

Text Generation • Updated May 22 • 12

ivankris/gemma-2b-Q4_K_M-GGUF

Updated May 22 • 9

AlirezaF138/Llama-3-Persian-8B-LoRA-Q6_K-GGUF

Updated May 22 • 26 • 4

AlirezaF138/persian_llama_7B_merged-Q6_K-GGUF

Text Generation • Updated May 22 • 17 • 1

tinybiggames/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 27 • 46 • 1

jeiku/Aura_3B-Q4_K_M-GGUF

Updated May 22 • 14

Ken0751/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 22 • 6

Salekeen/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 22 • 6

ybelkada/tiny-random-llama-Q4_K_M-GGUF

Updated May 22 • 18

AlirezaF138/AVA-Qwen1.5-7B-Chat-Q6_K-GGUF

Updated May 22 • 20

Bendy121165/gpt2-Q4_K_M-GGUF

Updated May 22 • 33

reach-vb/TinyLlama-1.1B-Chat-v0.5-Q2_K-GGUF

Updated May 22 • 32

linh5nb/Llama-2-7b-chat-luat-hon-nhan-1-Q4_K_M-GGUF

Updated May 22 • 29

GeorgeBredis/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 22 • 22

moshecohentheking/Hebrew-Mistral-7B-Q4_K_M-GGUF

Updated May 22 • 7

FilippoToso/Mistral-RAG-Q8_0-GGUF

Updated May 22 • 17

SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf

Text Generation • Updated May 22 • 17

aayushg159/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • Updated May 22 • 6

JeffreyLind/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated May 22 • 6

VlSav/saiga_llama3_8b_v7-Q6_K-GGUF

Updated Jul 9 • 32

NNet/saiga_llama3_8b-Q6_K-GGUF

Updated May 22 • 23

NikolayKozloff/Awanllm-Llama-3-8B-Cumulus-v0.3.2-Q4_0-GGUF

Updated May 22 • 47 • 1

NikolayKozloff/Awanllm-Llama-3-8B-Cumulus-v0.3.2-Q5_0-GGUF

Updated May 22 • 21 • 1

Earthkwake/Phi-3-mini-4k-instruct-Q4_0-GGUF

Text Generation • Updated May 22 • 52

mmacros/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated May 23 • 5

EZPK/guillaumetell-7b-Q4_K_M-GGUF

Text Generation • Updated May 23 • 13