Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

6,764

Full-text search

Active filters: llama-cpp

djuna/stella-base-en-v2-Q5_K_M-GGUF

Feature Extraction • Updated Jul 24 • 38

Kondara/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 24 • 3

shisahni/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 24 • 5

Kondara/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 24 • 4

MugenYume/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jul 24 • 95

SkyNotion/gemma-2-9b-it-abliterated-Q4_K_M-GGUF

Updated Jul 24 • 2

ddarolf/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 24 • 3

SkyNotion/Meta-Llama-3-8B-Instruct-abliterated-v3-Q4_K_M-GGUF

Updated Jul 24 • 4

skoppisetti/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 24 • 3

tt144/ReluLLaMA-7B-Q8_0-GGUF

jeiku/llama-3.1-ortho-baukit-79f-3000t-Q4_K_M-GGUF

Updated Jul 24 • 2 • 1

jeiku/llama-3.1-ortho-baukit-79f-3000t-Q6_K-GGUF

Updated Jul 24 • 2

NikolayKozloff/mistral-doryV2-12b-Q8_0-GGUF

Updated Jul 24 • 2 • 1

zhentaoyu/DeepSeek-V2-Lite-Chat-Q4_0-GGUF

Updated Jul 24 • 28

NikolayKozloff/mistral-doryV2-12b-Q6_K-GGUF

Updated Jul 24 • 4 • 1

NikolayKozloff/mistral-doryV2-12b-Q5_K_M-GGUF

Updated Jul 24 • 3 • 1

tt144/ReluLLaMA-7B-Q5_K_M-GGUF

NikolayKozloff/mistral-doryV2-12b-Q5_K_S-GGUF

Updated Jul 24 • 5 • 1

kowlick/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

Updated Jul 24 • 14

kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 24 • 5

SkyNotion/codegemma-2b-Q4_K_M-GGUF

Updated Jul 24 • 1

third0x/DeepSeek-V2-Lite-Chat-Q8_0-GGUF

Updated Jul 24 • 2

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 24 • 12

inflatebot/helide-alpha-r4-Q4_K_M-GGUF

Updated Jul 24 • 3

tt144/ReluLLaMA-7B-Q4_0-GGUF

Updated Jul 24 • 2

third0x/DeepSeek-V2-Lite-Chat-Q4_K_M-GGUF

Ruby-NewLeaf/WestLakeMultiverse-12B-MoE-Q4_K_M-GGUF

Updated Jul 24 • 5

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 24

hibikiass/Meta-Llama-3.1-8B-Claude-Q8_0-GGUF

Updated Jul 24 • 2 • 1

leonn71/Mistral-7B-v0.3-Q8_0-GGUF

Updated Jul 24 • 4