Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

3,723

Full-text search

Active filters: gguf-my-repo

eccheng/Phi-3-mini-128k-instruct-Q4_0-GGUF

Text Generation • Updated Jun 11 • 158

frcp/Ocelot-Ko-self-instruction-10.8B-v1.0-Q4_K_M-GGUF

Text Generation • Updated Jun 12 • 8

gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF

Text Generation • Updated Jun 12 • 10

frcp/gemma-summary-v01-Q4_K_M-GGUF

Text Generation • Updated Jun 12 • 19

farpluto/Phi-3-medium-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 12 • 7

zhentaoyu/Llama-2-7b-chat-hf-Q4_0-GGUF

Text Generation • Updated Jun 12 • 45

evshiron/Llama-3-8B-Sydney-Q4_K_M-GGUF

Updated Jun 12 • 16

magiccpp/open_llama_3b_v2-Q8_0-GGUF

Updated Jun 12 • 29

huggingkot/dolphin-2.9.2-Phi-3-Medium-abliterated-Q4_K_M-GGUF

Updated Jun 12 • 11

BLURPLETESTS/Llama3-Toxic-8B-imat-Q5_K_M-GGUF

Updated Jun 14 • 16

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated Jun 12 • 157 • 3

e2jhiubyiiyvw/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 12 • 12

Tech-Meld/Hajax_Chat_1.0-Q3_K_S-GGUF

Updated Jun 12 • 22

NikolayKozloff/CataLlama-v0.1-Instruct-SFT-Q8_0-GGUF

Text Generation • Updated Jun 12 • 16 • 1

debenoist/qlora_model_4_16bit-Q4_K_M-GGUF

Updated Jun 12 • 12

NikolayKozloff/CataLlama-v0.1-Instruct-DPO-Q8_0-GGUF

Text Generation • Updated Jun 12 • 13 • 1

NikolayKozloff/Ko-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 12 • 12 • 1

NikolayKozloff/Ko-Qwen2-7B-Instruct-Q8_0-GGUF

Updated Jun 12 • 17 • 3

albertodelazzari/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

Text Generation • Updated Jun 12 • 13

NikolayKozloff/Tesser-Llama-3-Ko-8B-Q4_0-GGUF

Text Generation • Updated Jun 12 • 66 • 1

NikolayKozloff/Tesser-Llama-3-Ko-8B-Q5_0-GGUF

Text Generation • Updated Jun 12 • 13 • 1

NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_XS-GGUF

Updated Jun 12 • 15 • 1

NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_NL-GGUF

Updated Jun 12 • 25 • 1

NikolayKozloff/shotor-Q8_0-GGUF

Text Generation • Updated Jun 12 • 24 • 1

VlSav/saiga_qwen2_7b_sft_m2_d6_kto_m1_d5-Q6_K-GGUF

Updated Jun 12 • 24

VlSav/saiga_llama3_8b_sft_m11_d5_abliterated_kto_m5_d3-Q6_K-GGUF

Updated Jun 12 • 16

huggingkot/Llama-3-8B-Instruct-abliterated-v2-Q4_K_M-GGUF

Updated Jun 12 • 14

albertodelazzari/Mistral-7B-Instruct-v0.3-Q8_0-GGUF

Updated Jun 12 • 10

sygenaithanos/Llama-3-8B-Instruct-Gradient-1048k-Q4_0-GGUF

Text Generation • Updated Jun 12 • 57

cleatherbury/TextBase-7B-v0.1-Q4_K_M-GGUF

Updated Jun 12 • 12