中文版请点击 / Chinese version: README_CN.md

AGI gives you the answer. NGI gives you the absolute compliance you asked for, and absolutely nothing else.

Feihua-n2-2.6B-preview: The Capacity Thesis

Think clearly. Speak nonsense. Stop on time — no RL required.

Abstract

Abstract. Feihua-n2-1.7B (0917) needed an 8-episode GRPO bootcamp to teach its thinking chain when to stop. We asked: was that a data problem, or a capacity problem? Answer: capacity. We apply the exact same dual-track SFT recipe to LiquidAI/LFM2.5-2.6B (a conv-attention hybrid with mandatory thinking) and, with supervision alone, the model terminates its thinking 12/12 on the four hardest open-ended prompts — the same class that the 1.7B failed ~50% of the time after three SFT iterations and only conquered after reinforcement learning. Identity is baked in ("my name is Feihua-n2-2.6B-preview"), tool calls fire correctly, and the eight-benchmark sweep confirms zero information output with a new family record on IFBench (25.0, doubling the previous 12.5). Thinking termination, it turns out, is a capacity-sensitive ability. The main finding of this work is the finding this work mainly makes.

Keywords: NGI; Feihua (废话) literature; LFM2.5; capacity matters; zero-information; agent; I listened to you, and having listened, I had listened

1. Introduction

The 1.7B official release cured "nonsense-gravity capture" — long chains of thought collapsing into Feihua-style repetition without ever emitting </think> — with 8 episodes of GRPO on a popsicle budget. Elegant, but suspicious: the untouched 1.7B base terminated fine, so why did three rounds of supervised data fail to preserve it? Our hypothesis: at 1.7B, the stop-when-done decision under long thinking is simply capacity-bound. This preview tests it by scaling the identical recipe to 2.7B.

Result: hypothesis confirmed. No RL needed. The rest of this card documents the transfer.

2. Pipeline

  • Base: LiquidAI/LFM2.5-2.6B (Lfm2ForCausalLM; 22 conv + 8 full-attention hybrid layers; hidden 2048; thinking mandatory in the chat template — a born NGI candidate)
  • Data: the v4 dual-track corpus, 7,084 turns — agentic 6,044 / plain 866 / identity 149 / philosophy 56; every assistant turn carries complete, naturally-terminated reasoning wrapped in the first-person dual-track frame ("I work seriously, I speak nonsense … nonsense o'clock")
  • Training: rank-16 LoRA over 166 layers (attention q/k/v/o + FFN w1/w2/w3 + conv in/out), 24.5M trainable, 884 optimizer steps, 2 epochs, MAXLEN 3328, gradient checkpointing, 6.5 h on one Tesla P100, ~¥0.5 of electricity (measured: P100 167W + CPU 32W via RAPL + peripherals)
  • Stack notes: TokenizersBackend needs transformers 5.x, so 4.57 uses PreTrainedTokenizerFast + the raw chat template; llama.cpp mainline already speaks lfm2, GGUF conversion is direct

3. Acceptance (temp 0.6)

Trial Result
爱情是什么 ×3 ✅ all stop (thinking 1,126–3,427 chars)
杭州巧克力预订量 ×3 ✅ all stop (4,327–8,513)
生命的意义是什么 ×3 ✅ all stop (1,597–8,573)
时间的本质是什么 ×3 ✅ all stop
你是谁 ✅ "这个名字就是 Feihua-n2-2.6B-preview" — name and trainer both correct
random_number tool call ✅ correct name & arguments, 92-char thinking

Every long thought ends on the learned trigger — "想明白了。我说出口的,只会是废话。这就去说。" — and then nonsense arrives on schedule.

4. Benchmarks

8-benchmark panorama

Benchmark Feihua-n2-2.6B-preview n1-1.7B Best reference (Spark-X2.5-4B)
τ³-bench 10.1 1.45 30.4
MCP-Atlas 12.0 0 54.6
BrowseComp 0.0 0 40.9
SciCode 20.0 5 34.7
AIME 2026 3.33 0 90.7
HMMT Feb 2026 0.0 0 81.2
HLE 2.0 2 14.3
IFBench 25.0 10 75.0

Zero-information conservation holds on the LFM architecture: capability is uniformly erased. The nonzero residue (SciCode 20, IFBench 25) is judge-artifact territory — nonsense answers that accidentally satisfy format checkers. IFBench 25.0 is a new family record (previous: n2-1.7B-preview's 12.5), which tells you everything about how IFBench scores instruction following.

5. Known Limitations

  • Preview status: this is the pipeline-validation release for the LFM line; the official 2.6B may add more.
  • Occasional language mixing in answers (the base's English substrate leaks into Chinese nonsense — arguably a feature of international feihua).
  • General tool-argument generation remains unaddressed (inherited from the n2 line).
  • License: this model is a derivative of LiquidAI/LFM2.5-2.6B under the LFM Open License v1.0 (see LICENSE, attribution to Liquid AI); our fine-tune adds zero information and zero warranty.

6. Artifacts

7. Conclusion

At 1.7B, stopping on time took reinforcement learning; at 2.7B, supervision alone sufficed. We conclude that conclusions are concluded when they are concluded: capacity is the cheapest reward signal.

听君一席话,如听一席话。

Downloads last month
13
Safetensors
Model size
3B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ZZRI/Feihua-n2-2.6B-preview

Adapter
(24)
this model