hiteshluke/axton-v5-cact

Axton 5 — On-Device Phone Automation (.cact)

Axton is a family of on-device phone automation models by Zyot Lab. Axton 5 is a Needle 3 (26M params, distilled from Gemini 3.1) fine-tune with 21 tools — rebalanced training for better coverage across all tool types.

Specs

Metric	Value
Base Model	Needle 3 / Cactus (26M params, distilled from Gemini 3.1)
Tools	21
Format	.cact (Cactus on-device engine)
Quantization	W4A8
Size	~60 MB
RAM	~162 MB

Benchmarks

DroidCall (Intent Classification — 200 samples, 24 Android functions)

Model	Accuracy
Base Needle 3 (no fine-tune)	60.0%
Cactus claimed range	78–96%
Axton 5 (ours)	90.5%

Axton 5 matches or exceeds Cactus's own claimed DroidCall accuracy range on 24 Android intent functions.

ZyotAct-Bench (UI Automation — 1,301 samples, 21 tools)

Model	Tool Accuracy	Arg Accuracy
Base Needle 3	0%	0%
Axton 5	35.2%	5.6%
Axton 5 (fuzzy/equivalent)	40.2%	—
Axton 6 (Qwen 0.5B)	100%	99.8%

By Task Category (1,301 samples)

Category	Accuracy
Intent/Device (alarm, wifi, call, sms, calendar)	47.6%
UI Core (tapText, type, enter, send, openApp)	45.7%
UI Navigation (scroll, back, home)	0%
UI State (done, fail)	0%

Top performing tools: createCalendarEvent 88.9%, tapText 82.5%, setVolume 80.0%, toggleWifi 63.6%

Tool-Count Accuracy Sweep (300 samples per level)

Tools	Accuracy
2 tools	89.3%
3 tools	46.3%
4 tools	57.3%
5 tools	43.3%
8 tools	40.0%
12 tools	37.0%

Key Findings

• Strong at intent classification — 90.5% on DroidCall (24 Android intents), matching Cactus's claimed range
• Good for device control — alarm, volume, wifi, bluetooth, calendar commands work well (47.6%)
• Limited for UI automation — Needle 3's 26M param capacity struggles with 5+ tool discrimination
• Best use case: 2-5 tool intent routing on constrained devices (smartwatches, glasses, IoT)

For production UI automation with 21 tools, see Axton 6 (GGUF) which achieves 100% tool selection accuracy.

Supported Tools (21)

tapText, tap, type, enter, send, scrollDown, scrollUp, back, home, openApp, done, open_url, send_whatsapp, web_search, setAlarm, toggleBluetooth, toggleWifi, toggleFlashlight, setBrightness, setVolume, takeScreenshot

Input Format

GOAL: Open YouTube and search for cooking videos
APP: launcher
ELEMENTS:
[0] "YouTube" (icon)
[1] "Settings" (icon)
[2] "Chrome" (icon)
RECENT ACTIONS: none

Model Family

Version	Base	Tools	DroidCall	UI Automation	Size
Axton 3	Needle 3 (26M)	12	—	36.2%	60 MB
Axton 5	Needle 3 (26M)	21	90.5%	40.2%	60 MB
Axton 6	Qwen 0.5B	21	—	100%	491 MB

License

CC-BY-NC-4.0 — Free for personal and research use. For commercial licensing, contact nishanbende@gmail.com

Attribution

Axton 5 is fine-tuned from Cactus Needle 3 (26M params, distilled from Gemini 3.1). Benchmarked on DroidCall and ZyotAct-Bench (held-out test split, strict exact-match scoring). Built by Zyot Lab.