Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

3,980

Full-text search

Active filters: llama-cpp

e2jhiubyiiyvw/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 12 • 12

Tech-Meld/Hajax_Chat_1.0-Q3_K_S-GGUF

Updated Jun 12 • 22

NikolayKozloff/CataLlama-v0.1-Instruct-SFT-Q8_0-GGUF

Text Generation • Updated Jun 12 • 17 • 1

debenoist/qlora_model_4_16bit-Q4_K_M-GGUF

Updated Jun 12 • 11

NikolayKozloff/CataLlama-v0.1-Instruct-DPO-Q8_0-GGUF

Text Generation • Updated Jun 12 • 12 • 1

NikolayKozloff/Ko-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 12 • 12 • 1

NikolayKozloff/Ko-Qwen2-7B-Instruct-Q8_0-GGUF

Updated Jun 12 • 14 • 3

albertodelazzari/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF

Text Generation • Updated Jun 12 • 13

NikolayKozloff/Tesser-Llama-3-Ko-8B-Q4_0-GGUF

Text Generation • Updated Jun 12 • 49 • 1

NikolayKozloff/Tesser-Llama-3-Ko-8B-Q5_0-GGUF

Text Generation • Updated Jun 12 • 14 • 1

NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_XS-GGUF

Updated Jun 12 • 14 • 1

NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_NL-GGUF

Updated Jun 12 • 25 • 1

NikolayKozloff/shotor-Q8_0-GGUF

Text Generation • Updated Jun 12 • 31 • 1

VlSav/saiga_qwen2_7b_sft_m2_d6_kto_m1_d5-Q6_K-GGUF

Updated Jun 12 • 23

VlSav/saiga_llama3_8b_sft_m11_d5_abliterated_kto_m5_d3-Q6_K-GGUF

Updated Jun 12 • 16

huggingkot/Llama-3-8B-Instruct-abliterated-v2-Q4_K_M-GGUF

Updated Jun 12 • 12

albertodelazzari/Mistral-7B-Instruct-v0.3-Q8_0-GGUF

Updated Jun 12 • 10

sygenaithanos/Llama-3-8B-Instruct-Gradient-1048k-Q4_0-GGUF

Text Generation • Updated Jun 12 • 47

cleatherbury/TextBase-7B-v0.1-Q4_K_M-GGUF

Updated Jun 12 • 11

v000000/L3-8B-Poppy-Moonfall-C-Q8_0-GGUF

Updated Jun 14 • 18

v000000/L3-8B-Poppy-Moonfall-OG-Q8_0-GGUF

Updated Jun 14 • 15

v000000/SyntheticMoist-11B-v2-Q6_K-GGUF

Updated Jun 13 • 12

pabloce/Tess-v2.5-Qwen2-72B-gguf

Updated Jun 12 • 38 • 1

v000000/L3-8B-Serpentine-Q8_0-GGUF

Updated Jun 14 • 12

v000000/L3-8B-BlueSerpentine-Q8_0-GGUF

Updated Jun 14 • 13 • 1

HDiffusion/Llama3-8b-CunnyGPT-16bit-Q4_K_M-GGUF

Updated Jun 13 • 99 • 1

jeiku/Aura_Qwen_7B-Q3_K_S-GGUF

Updated Jun 13 • 13

wyan/Llama-3-8B-Lexi-Uncensored-Q4_K_M-GGUF

Updated Jun 13 • 29 • 1

wyan/Llama-3-8B-Lexi-Uncensored-Q8_0-GGUF

Updated Jun 13 • 65 • 1

nakcnx/THaLLE-q5-k-m-gguf

Text Generation • Updated Jun 13 • 21