Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open
  Language Foundation
Authors: name: Ling-Team; name: Ang Li; name: Ben Liu; name: Binbin Hu; name: Bing Li; name: Bingwei Zeng; name: Borui Ye; name: Caizhi Tang; name: Changxin Tian; name: Chao Huang; name: Chao Zhang; name: Chen Qian; name: Chenchen Ju; name: Chenchen Li; name: Chengfu Tang; name: Chili Fu; name: Chunshao Ren; name: Chunwei Wu; name: Cong Zhang; name: Cunyin Peng; name: Dafeng Xu; name: Daixin Wang; name: Dalong Zhang; name: Dingnan Jin; name: Dingyuan Zhu; name: Dongke Hu; name: Fangzheng Zhao; name: Feifan Wu; name: Feng Zhu; name: Gangshan Wang; name: Haitao Zhang; name: Hailin Zhao; name: Hanxiao Zhang; name: Hanzi Wang; name: Hao Qian; name: Haoyi Yu; name: Heng Zhang; name: Hongliang Zhang; name: Hongzhi Luan; name: Huirong Dong; name: Huizhong Li; name: Jia Li; name: Jia Liu; name: Jialong Zhu; name: Jian Sha; name: Jianping Wei; name: Jiaolong Yang; name: Jieyue Ma; name: Jiewei Wu; name: Jinjing Huang; name: Jingyun Tian; name: Jingyuan Zhang; name: Jinquan Sun; name: Juanhui Tu; name: Jun Liu; name: Jun Xu; name: Jun Zhou; name: Junjie Ou; name: Junpeng Fang; name: Kaihong Zhang; name: Kaiqin Hu; name: Ke Shi; name: Kun Tang; name: Kunlong Chen; name: Lanyin Mei; name: Lei Liang; name: Lei Xu; name: Libo Zhang; name: Lin Ju; name: Lin Yuan; name: Ling Zhong; name: Lintao Ma; name: Lu Liu; name: Lu Yu; name: Lun Cai; name: Meiqi Zhu; name: Mengying Li; name: Min Chen; name: Minghao Xue; name: Minghong Cai; name: Mingming Yin; name: Peijie Jiang; name: Peilong Zhao; name: Pingping Liu; name: Qian Zhao; name: Qing Cui; name: Qingxiang Huang; name: Qingyuan Yang; name: Quankun Yu; name: Shaowei Wei; name: Shijie Lian; name: Shoujian Zheng; name: Shun Song; name: Shungen Zhang; name: Shuo Zhang; name: Siyuan Li; name: Song Liu; name: Ting Guo; name: Tong Zhao; name: Wanli Gu; name: Weichang Wu; name: Weiguang Han; name: Wenjing Fang; name: Wubin Wang; name: Xiang Shu; name: Xiao Shi; name: Xiaoshun Lan; name: Xiaolu Zhang; name: Xiaqing Sun; name: Xin Zhao; name: Xingyu Lu; name: Xiong Xu; name: Xudong Wang; name: Xudong Wang; name: Xuemin Yang; name: Yajie Yang; name: Yang Xiang; name: Yanzhe Li; name: Yi Zhang; name: Yilong Wang; name: Yingxue Li; name: Yongzhen Guo; name: Yuzhuo Fu; name: Yuanyuan Wang; name: Yue Yang; name: Yue Yu; name: Yufeng Deng; name: Yun Zhang; name: Yunfei Xu; name: Yuqi Zhang; name: Yuxiao He; name: Zengke Gui; name: Zhaoxin Huan; name: Zhaoyang Wang; name: Zhibo Zhu; name: Zhihao Wang; name: Zhiqiang Zhang; name: Zhoufei Wang; name: Zihang Zeng; name: Ziqi Liu; name: Zitao Xuan; name: Zuoli Tang
Published: 2025-10-25 01:51:37

Abstract: We introduce Ling 2.0, a series reasoning-oriented language foundation built
upon the principle that every activation boosts reasoning capability. Designed
to scale from tens of billions to one trillion parameters under a unified
Mixture-of-Experts (MoE) paradigm, Ling 2.0 emphasizes high sparsity,
cross-scale consistency, and efficiency guided by empirical scaling laws. The
series includes three non-thinking (instruct) models - Ling-mini-2.0,
Ling-flash-2.0, and Ling-1T - ranging from 16B to 1T total parameters and
achieving up to 7-fold active-compute efficiency compared with dense
counterparts. Ling 2.0 integrates coordinated innovations across model
architecture, pre-training, post-training, and infrastructure: a high-sparsity
MoE with MTP for efficient reasoning, reasoning-oriented data and mid-training
CoT activation, reinforcement-based fine-tuning (DFT, Evo-CoT), and full-scale
FP8 training with fine-grained heterogeneous pipelines. At the trillion scale,
Ling-1T establishes a new Pareto frontier of reasoning accuracy versus
computational efficiency, demonstrating that sparse activation, when properly
aligned with reasoning objectives, enables scalable and efficient intelligence.
Collectively, Ling 2.0 provides a coherent, open, and efficient foundation for
advancing future reasoning and thinking models, including the Ring series built
upon the same base.