Entry-Coder-0.5-v3-256k (GGUF Quantizations)
Optimized GGUF quantized releases for Secondchancee/entry-coder-0.5-v3-256k.
Designed for ultra-fast, local on-device inference using llama.cpp, LM Studio, Ollama, Jan, and ZCode.
Available Quantizations & Hardware Compatibility
| Quantization | Bits | File Size | Recommended Hardware | Status |
|---|---|---|---|---|
| Q8_0 | 8-bit | ~524 MB | Any CPU / Apple Silicon / GPU (>1GB VRAM) | Maximum Precision |
| Q4_K_M | 4-bit | ~325 MB | Ultra-light, embedded / Raspberry Pi / Any PC | High Speed & Balanced |
1-Click Download Links
Quick Start with llama.cpp
# Run 8-bit quantization
./llama-cli -m entry-coder-0.5-v3-256k-Q8_0.gguf -p "Write a Next.js 15 Server Action for user signup" -n 512
# Run 4-bit quantization
./llama-cli -m entry-coder-0.5-v3-256k-Q4_K_M.gguf -p "Write a Next.js 15 Server Action for user signup" -n 512
Model tree for Secondchancee/entry-coder-0.5-v3-256k-GGUF
Base model
Qwen/Qwen2.5-0.5B Finetuned
Qwen/Qwen2.5-Coder-0.5B Finetuned
Qwen/Qwen2.5-Coder-0.5B-Instruct Quantized
Secondchancee/entry-coder-0.5-v3-256k