view post Post 8911 Gemma 4 12B can now run locally on just 8GB RAM via Dynamic GGUFs.Google's new model, Gemma 4 12B Unified supports image, audio and 256K context.You can run and train the model via Unsloth Studio.GGUF: unsloth/gemma-4-12b-it-GGUFGuide: https://unsloth.ai/docs/models/gemma-4 See translation 5 replies · 🔥 43 43 👍 13 13 🤗 2 2 + Reply
Running Agents 77 Accurate GGUF Memory Calculator 📊 77 Calculate memory for GGUF models using GPU layers + context