Raon-1-mini-preview — hipfire MQ4 XTS

hipfire quantization of KRAFTON/Raon-1-mini-preview (28.8B total / 4.3B active MoE; RDA gated-delta + MLA attention, 4-stream mHC residuals, SiTU experts). Base model by KRAFTON, Apache-2.0.

File	Size	sha256
raon-1-mini-preview.mq4-xts	17.70 GB (17,703,923,580 B)	3828f98015767c9f79ea9aa1981312f061b1e1ab80303db9984577bfc7459103

hipfire pull raon-1-mini-preview
hipfire serve raon-1-mini-preview

Quantization

• Routed, shared and dense-MLP experts: symmetric MQ4V2 (qt 44) with per-group AWQ alpha and GPTQ scale refit (XTS).
• Attention (MLA and RDA projections incl. gates and LoRA factors) and lm_head: Q8F16.

KLD vs the BF16 teacher (transformers, top-256 + tail, no BOS):

Set	This file	Same layout, RTN experts
WikiText-2 (2048 × 24)	0.081	0.102
code (512 × 24)	0.0138	0.019

Speed

tok/s on our cards, median of 3 fresh processes × 3 reps (raon-bench protocol: prompt-processing at 512/2048/8192/16384 tokens, 128-token greedy decode). The RX 7900 XTX was measured with its maximum shader clock capped at 2,400 MHz on that host; stock clocks may differ.

Card	pp512	pp2048	pp8192	pp16384	tg128
RX 7900 XTX (gfx1100, 24 GB)	2,568	2,552	2,332	1,798	63.9
Radeon AI PRO R9700 (gfx1201, 32 GB)	2,927	2,895	2,742	2,545	71.4

RX 7900 XT (20 GB): not yet measured on real hardware. Under a 20 GB capacity emulation on the XTX (which limits memory, not compute or bandwidth) the file loads with 131K context, a 27K-token needle is recalled exactly, and 32K-token prompt processing runs at 1,312 tok/s. Real 7900 XT numbers will be added once measured.

Serving

Reasoning model, thinking on by default (enable_thinking: false supported); XML <tool_call> tools; OpenAI and Anthropic endpoints. Prompts render byte-identically to the reference chat template. Recommended sampling (from the model card): temperature 1.0, top_p 0.95, top_k 20, min_p 0, presence_penalty 1.5 (0 for coding/math).

Credits

KRAFTON for the model. u/Queasy_Asparagus69 (Hugging Face: datayoda) wrote the first community hipfire port and reported the serving bugs fixed in this release.