NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid
  Mamba-Transformer Reasoning Model
Authors: name: NVIDIA, name: Aarti Basant, name: Abhijit Khairnar, name: Abhijit Paithankar, name: Abhinav Khattar, name: Adi Renduchintala, name: Adithya Renduchintala, name: Aditya Malte, name: Akhiad Bercovich, name: Akshay Hazare, name: Alejandra Rico, name: Aleksander Ficek, name: Alex Kondratenko, name: Alex Shaposhnikov, name: Ali Taghibakhshi, name: Amelia Barton, name: Ameya Sunil Mahabaleshwarkar, name: Amy Shen, name: Andrew Tao, name: Ann Guan, name: Anna Shors, name: Anubhav Mandarwal, name: Arham Mehta, name: Arun Venkatesan, name: Ashton Sharabiani, name: Ashwath Aithal, name: Ashwin Poojary, name: Ayush Dattagupta, name: Balaram Buddharaju, name: Banghua Zhu, name: Barnaby Simkin, name: Bilal Kartal, name: Bita Darvish Rouhani, name: Bobby Chen, name: Boris Ginsburg, name: Brandon Norick, name: Brian Yu, name: Bryan Catanzaro, name: Charles Wang, name: Charlie Truong, name: Chetan Mungekar, name: Chintan Patel, name: Chris Alexiuk, name: Christian Munley, name: Christopher Parisien, name: Dan Su, name: Daniel Afrimi, name: Daniel Korzekwa, name: Daniel Rohrer, name: Daria Gitman, name: David Mosallanezhad, name: Deepak Narayanan, name: Dima Rekesh, name: Dina Yared, name: Dmytro Pykhtar, name: Dong Ahn, name: Duncan Riach, name: Eileen Long, name: Elliott Ning, name: Eric Chung, name: Erick Galinkin, name: Evelina Bakhturina, name: Gargi Prasad, name: Gerald Shen, name: Haim Elisha, name: Harsh Sharma, name: Hayley Ross, name: Helen Ngo, name: Herman Sahota, name: Hexin Wang, name: Hoo Chang Shin, name: Hua Huang, name: Iain Cunningham, name: Igor Gitman, name: Ivan Moshkov, name: Jaehun Jung, name: Jan Kautz, name: Jane Polak Scowcroft, name: Jared Casper, name: Jimmy Zhang, name: Jinze Xue, name: Jocelyn Huang, name: Joey Conway, name: John Kamalu, name: Jonathan Cohen, name: Joseph Jennings, name: Julien Veron Vialard, name: Junkeun Yi, name: Jupinder Parmar, name: Kari Briski, name: Katherine Cheung, name: Katherine Luna, name: Keith Wyss, name: Keshav Santhanam, name: Kezhi Kong, name: Krzysztof Pawelec, name: Kumar Anik, name: Kunlun Li, name: Kushan Ahmadian, name: Lawrence McAfee, name: Laya Sleiman, name: Leon Derczynski, name: Luis Vega, name: Maer Rodrigues de Melo, name: Makesh Narsimhan Sreedhar, name: Marcin Chochowski, name: Mark Cai, name: Markus Kliegl, name: Marta Stepniewska-Dziubinska, name: Matvei Novikov, name: Mehrzad Samadi, name: Meredith Price, name: Meriem Boubdir, name: Michael Boone, name: Michael Evans, name: Michal Bien, name: Michal Zawalski, name: Miguel Martinez, name: Mike Chrzanowski, name: Mohammad Shoeybi, name: Mostofa Patwary, name: Namit Dhameja, name: Nave Assaf, name: Negar Habibi, name: Nidhi Bhatia, name: Nikki Pope, name: Nima Tajbakhsh, name: Nirmal Kumar Juluru, name: Oleg Rybakov, name: Oleksii Hrinchuk, name: Oleksii Kuchaiev, name: Oluwatobi Olabiyi, name: Pablo Ribalta, name: Padmavathy Subramanian, name: Parth Chadha, name: Pavlo Molchanov, name: Peter Dykas, name: Peter Jin, name: Piotr Bialecki, name: Piotr Januszewski, name: Pradeep Thalasta, name: Prashant Gaikwad, name: Prasoon Varshney, name: Pritam Gundecha, name: Przemek Tredak, name: Rabeeh Karimi Mahabadi, name: Rajen Patel, name: Ran El-Yaniv, name: Ranjit Rajan, name: Ria Cheruvu, name: Rima Shahbazyan, name: Ritika Borkar, name: Ritu Gala, name: Roger Waleffe, name: Ruoxi Zhang, name: Russell J. Hewett, name: Ryan Prenger, name: Sahil Jain, name: Samuel Kriman, name: Sanjeev Satheesh, name: Saori Kaji, name: Sarah Yurick, name: Saurav Muralidharan, name: Sean Narenthiran, name: Seonmyeong Bak, name: Sepehr Sameni, name: Seungju Han, name: Shanmugam Ramasamy, name: Shaona Ghosh, name: Sharath Turuvekere Sreenivas, name: Shelby Thomas, name: Shizhe Diao, name: Shreya Gopal, name: Shrimai Prabhumoye, name: Shubham Toshniwal, name: Shuoyang Ding, name: Siddharth Singh, name: Siddhartha Jain, name: Somshubra Majumdar, name: Stefania Alborghetti, name: Syeda Nahida Akter, name: Terry Kong, name: Tim Moon, name: Tomasz Hliwiak, name: Tomer Asida, name: Tony Wang, name: Twinkle Vashishth, name: Tyler Poon, name: Udi Karpas, name: Vahid Noroozi, name: Venkat Srinivasan, name: Vijay Korthikanti, name: Vikram Fugro, name: Vineeth Kalluru, name: Vitaly Kurin, name: Vitaly Lavrukhin, name: Wasi Uddin Ahmad, name: Wei Du, name: Wonmin Byeon, name: Ximing Lu, name: Xin Dong, name: Yashaswi Karnati, name: Yejin Choi, name: Yian Zhang, name: Ying Lin, name: Yonggan Fu, name: Yoshi Suhara, name: Zhen Dong, name: Zhiyu Li, name: Zhongbo Zhu, name: Zijia Chen

We introduce Nemotron-Nano-9B-v2, a hybrid Mamba-Transformer language model
designed to increase throughput for reasoning workloads while achieving
state-of-the-art accuracy compared to similarly-sized models.
Nemotron-Nano-9B-v2 builds on the Nemotron-H architecture, in which the
majority of the self-attention layers in the common Transformer architecture
are replaced with Mamba-2 layers, to achieve improved inference speed when
generating the long thinking traces needed for reasoning. We create
Nemotron-Nano-9B-v2 by first pre-training a 12-billion-parameter model
(Nemotron-Nano-12B-v2-Base) on 20 trillion tokens using an FP8 training recipe.
After aligning Nemotron-Nano-12B-v2-Base, we employ the Minitron strategy to
compress and distill the model with the goal of enabling inference on up to
128k tokens on a single NVIDIA A10G GPU (22GiB of memory, bfloat16 precision).
Compared to existing similarly-sized models (e.g., Qwen3-8B), we show that
Nemotron-Nano-9B-v2 achieves on-par or better accuracy on reasoning benchmarks
while achieving up to 6x higher inference throughput in reasoning settings like
8k input and 16k output tokens. We are releasing Nemotron-Nano-9B-v2,
Nemotron-Nano12B-v2-Base, and Nemotron-Nano-9B-v2-Base checkpoints along with
the majority of our pre- and post-training datasets on Hugging Face.