Models

5,760

Base only

Active filters: llama.cpp

QuantFactory/TextBase-7B-v0.1-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 37

njwright92/ComicBot_v.2-gguf

Text Generation • 7B • Updated Aug 30, 2024 • 46

Irathernotsay/qwen2-1.5B-medical_qa-Finetune

Text Generation • 2B • Updated Jul 17, 2024 • 2

palusi/Qwen2-0.5B-Instruct-GGUF

0.5B • Updated Jun 27, 2024 • 94

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k

Text Generation • Updated Jul 9, 2024 • 22 •

ruslanmv/Medical-Llama3-v2-Q4_K_M-GGUF

8B • Updated Jun 30, 2024 • 16

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF

Text Generation • Updated Jul 9, 2024 • 17

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ

Text Generation • Updated Jul 9, 2024 • 4

zhhan/Phi-3-mini-4k-instruct_gguf_derived

Summarization • 4B • Updated Jul 2, 2024 • 27

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ

Text Generation • Updated Jul 9, 2024 • 3

mgonzs13/stablelm-zephyr-3B-localmentor-GGUF

Text Generation • 3B • Updated Jul 3, 2024 • 194

google/gemma-2-2b-GGUF

3B • Updated Aug 2, 2024 • 31 • 20

chatpdflocal/llama3.1-8b-gguf

8B • Updated Mar 23 • 269 • 29

akshathmangudi/llama3.1-8b-gguf

Updated Jul 26, 2024

dahara1/llama-translate-gguf

8B • Updated Aug 14, 2024 • 66 • 16

jhilburn/gemma-inference

Text Generation • Updated Aug 7, 2024

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • 8B • Updated Aug 26, 2024 • 111 • 6

PaulJusst/codegemma-7b-it-GGUF

Text Generation • 9B • Updated Sep 13, 2024

v000000/Typhon-Mixtral-v1-imatrix-v2.Q6_K-GGUF

Updated Sep 26, 2024 • 34

cstr/Ministral-8B-Instruct-2410-GGUF

8B • Updated Oct 17, 2024 • 59 • 1

mrcuddle/Lumimaid-v0.2-12B-Q4_K_M-GGUF

Text Generation • 12B • Updated Oct 20, 2024 • 13

Manel/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

8B • Updated Nov 3, 2024 • 7

Manel/Llama-2-13b-chat-hf-Q4_0-GGUF

Text Generation • 13B • Updated Nov 3, 2024 • 2

dumb-dev/flan-t5-xxl-gguf

11B • Updated Oct 29, 2024 • 416 • 18

Manel/gemma-2-9b-Q4_0-GGUF

9B • Updated Nov 3, 2024 • 2

DiYaZeN/aya-sl-biz-8b

Text Generation • 8B • Updated Oct 31, 2024 • 6

shreyasmeher/ConflLlama

Text Classification • 8B • Updated Jul 8, 2025 • 33 • 4

dwikitheduck/gen-try1-Q4_K_M-GGUF

15B • Updated Nov 11, 2024

shreyasmeher/ConflLlama-Alt

Text Classification • 8B • Updated Nov 19, 2024 • 2 • 1

XeAI/LLaMa_3.2_3B_Instruct_Text2SQL-Q4_K_M-GGUF

Text Generation • Updated Nov 17, 2024 • 17