gemma-4-E4B-wallet-ft

A LoRA fine-tune of Gemma-4 E4B that turns a natural-language wallet request into the exact structured tool call a macOS Ethereum wallet can execute — resolving ENS names, selecting from five tools, and converting human amounts to base units.

"Send 0.1 ETH to vitalik.eth"

[{"name": "executeTx",
  "arguments": {"chainId": "1",
                "to": "0xd8dA6BF26964aF9D7eEd9e03E53415D37aA96045",
                "value": "100000000000000000",
                "function": null, "args": []}}]

Results

On the 307-case evaluation set, scored by exact match on every field of every call:

Model Score
Gemma-4 E4B base (what the wallet ships today) 9.8%
This fine-tune 80.1%
gpt-5 (capable anchor) 96.7%
Category Cases Score
transfers 101 71.3%
swaps 96 83.3%
multi-turn 75 81.3%
ablation + refusal 35 94.3%

A 70-point lift over the shipped base model, on-device, at Q4_K_M.

Contents

  • gemma-4-E4B-wallet-ft.Q4_K_M.gguf — merged + quantised, 5.3 GB, runs via llama-cpp-python
  • adapter/ — the LoRA adapter (r=16, α=16) and training state

Usage

from llama_cpp import Llama
llm = Llama.from_pretrained(repo_id="ef-dai-team/gemma-4-E4B-wallet-ft",
                            filename="*Q4_K_M.gguf", n_ctx=4096)

Serve it with the system role (not developer) and the Gemma-4 delimiter dialect. The evaluation harness's provider handles both.

Training data

ef-dai-team/wallet-tool-calling-ft — 1739 SFT examples, disjoint from the evaluation set by construction, which is what makes the numbers above meaningful rather than memorisation.

The same recipe on a smaller model

Applied to FunctionGemma-270M the identical data and recipe produced no lift at all (8.1% → 8.8%, and 0% on every category requiring a call) — see ef-dai-team/functiongemma-270m-wallet-ft. Model capacity, not data, was the constraint.

Evaluation

Full per-case results, including this model's actual output on all 307 cases, are in the eval report Space.

License

Apache-2.0, matching the base model google/gemma-4-E4B-it. The training data is Apache-2.0 as well.

Downloads last month
36
GGUF
Model size
8B params
Architecture
gemma4
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ef-dai-team/gemma-4-E4B-wallet-ft

Adapter
(311)
this model