Maximilian228/Geode-Gemma-4-E4B

Geode · Gemma 4 E4B for phones

A model pack for Geode, an Android app that runs language models entirely on the phone: no cloud, no account. Gemma 4 E4B is the larger of Google's two small multimodal models: it reads images, watches video, hears voice and sound, and calls the agent's tools - with noticeably better answers than E2B, at about two thirds of its speed. Geode runs it with its own engine (not LiteRT-LM), from Google's quantization-aware-trained (QAT) 4-bit weights.

Packs

Folder	Weights	Size	Quality (KL vs BF16 / top-1)	For
Q4/	Google's QAT Q4_0 weights, 4-bit with a searched scale per 16 values; vision and audio encoders 8-bit; the MTP drafter 8-bit	4.8 GB (4.43 GiB): 2.6 GB in memory, the per-layer embeddings read from flash	not measured yet	any 64-bit phone with 8 GB of RAM or more

What is in the pack: the language model (dense.bin), its per-layer embeddings (ple.bin, read from flash as they are needed), the vision encoder (vision.bin: photos, and video frames at 70 tokens each), the audio encoder (audio.bin: up to 30 s of sound, one token per 40 ms), the multi-token-prediction drafter (drafter.bin, from Google's QAT assistant model: the same answer, every draft checked) and the tokenizer.

On a Snapdragon 8 Elite phone (RedMagic 10 Pro), the default run mode (NPU + GPU): a 1,300-token prompt reads at 940 tokens/s on the NPU (Hexagon: whole layers, attention included, on its matrix units), and the answer is written on the Adreno graphics chip at ~29-40 tokens/s with the drafter. A photo is encoded in ~0.9 s and 10 s of sound in ~0.3 s, on the NPU too. Where the NPU is not available, an Adreno 7xx or newer graphics chip takes the prompt instead (200 tokens/s); other graphics chips (Mali, older Adreno) are not used. In Geode's Model settings you can choose which units run it.

The packs are Geode's own format (geode.json describes the files). They are not GGUF and do not load in other runtimes.

Use

1. Install Geode (Google Play beta: geode.tifu.xyz).
2. Models → pick Gemma 4 E4B in Geode's catalog (or Download from Hugging Face → Maximilian228/Geode-Gemma-4-E4B).
3. In a chat: attach a photo or a video, hold the microphone button to say what you want, or attach a sound file.

Voice messages, sound and video are processed on the phone and kept with their chat there; nothing is sent anywhere.

Requirements: Android 11+, a 64-bit ARM processor with the dot-product instructions (ARMv8.2), 8 GB of RAM, and free storage for the pack. On a 6 GB phone choose Gemma 4 E2B instead.

License

Apache-2.0, as the base model: this pack is a quantized derivative of google/gemma-4-E4B-it-qat-q4_0-unquantized and its QAT assistant by Google (see LICENSE and the Gemma 4 license). Answers come from an AI model and can be wrong.