flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf
Updated
•
14
Q4_0_4_4-GGUF
GGUF dedicated for ARM NEON devices
-
-
flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf
Updated • 49 -
flyfishstudio/rocket-3b-Q4_0_4_4.gguf
Updated • 12 -
flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf
Updated • 25 -
flyfishstudio/openhermes-2.5-mistral-7b-Q4_0_4_4.gguf
Updated • 19 -
flyfishstudio/meta-llama-3.1-8b-instruct-Q4_0_4_4.gguf
Updated • 20 -
flyfishstudio/orca_mini_v3_7b-Q4_0_4_4.gguf
Updated • 65 -
flyfishstudio/SmolLM-1.7B-Instruct-v0.2-Q4_0_4_4.gguf
Updated • 4 -
flyfishstudio/Qwen1.5-1.8B-layla-v4-Q4_0_4_4.gguf
Updated • 7 -
flyfishstudio/Mistral-7B-Instruct-v0.3-Q4_0_4_4.gguf
Updated • 33 -
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_4.gguf
Updated • 38 -
flyfishstudio/tinyllama-1.1b-chat-v1.0-Q4_0_4_4.gguf
Updated • 10 -
flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_4.gguf
Updated • 37 -
flyfishstudio/qwen2-0_5b-instruct-Q4_0_4_4.gguf
Updated • 39 -
flyfishstudio/Phi-3.5-mini-instruct_Uncensored-Q4_0_4_4.gguf
Updated • 229 -
flyfishstudio/Phi-3.5-mini-instruct-Q4_0_4_4.gguf
Updated • 32 -
flyfishstudio/Phi-3.1-mini-4k-instruct-Q4_0_4_4.gguf
Updated • 48 -
flyfishstudio/llama-2-7b-chat-Q4_0_4_4.gguf
Updated • 11 -
flyfishstudio/gemma_2_2b_it_v2-Q4_0_4_4.gguf
Updated • 32 -
flyfishstudio/gemma-2-9b-it-abliterated-Q4_0_4_4.gguf
Updated • 28 -
TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
Updated • 5.82k • 35 -
adamo1139/magnum-v2-4b-gguf-lowctx
Updated • 111 -
ThomasBaruzier/Llama-3.1-Minitron-4B-Width-Base-GGUF
Updated • 491 • 3 -
flyfishstudio/gemma-2-2b-it-abliterated-Q4_0_4_4.gguf
Updated • 91