NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid
  Mamba-Transformer Reasoning Model
Authors: name: NVIDIA; name: Aarti Basant; name: Abhijit Khairnar; name: Abhijit Paithankar; name: Abhinav Khattar; name: Adi Renduchintala; name: Adithya Renduchintala; name: Aditya Malte; name: Akhiad Bercovich; name: Akshay Hazare; name: Alejandra Rico; name: Aleksander Ficek; name: Alex Kondratenko; name: Alex Shaposhnikov; name: Ali Taghibakhshi; name: Amelia Barton; name: Ameya Sunil Mahabaleshwarkar; name: Amy Shen; name: Andrew Tao; name: Ann Guan; name: Anna Shors; name: Anubhav Mandarwal; name: Arham Mehta; name: Arun Venkatesan; name: Ashton Sharabiani; name: Ashwath Aithal; name: Ashwin Poojary; name: Ayush Dattagupta; name: Balaram Buddharaju; name: Banghua Zhu; name: Barnaby Simkin; name: Bilal Kartal; name: Bita Darvish Rouhani; name: Bobby Chen; name: Boris Ginsburg; name: Brandon Norick; name: Brian Yu; name: Bryan Catanzaro; name: Charles Wang; name: Charlie Truong; name: Chetan Mungekar; name: Chintan Patel; name: Chris Alexiuk; name: Christian Munley; name: Christopher Parisien; name: Dan Su; name: Daniel Afrimi; name: Daniel Korzekwa; name: Daniel Rohrer; name: Daria Gitman; name: David Mosallanezhad; name: Deepak Narayanan; name: Dima Rekesh; name: Dina Yared; name: Dmytro Pykhtar; name: Dong Ahn; name: Duncan Riach; name: Eileen Long; name: Elliott Ning; name: Eric Chung; name: Erick Galinkin; name: Evelina Bakhturina; name: Gargi Prasad; name: Gerald Shen; name: Haim Elisha; name: Harsh Sharma; name: Hayley Ross; name: Helen Ngo; name: Herman Sahota; name: Hexin Wang; name: Hoo Chang Shin; name: Hua Huang; name: Iain Cunningham; name: Igor Gitman; name: Ivan Moshkov; name: Jaehun Jung; name: Jan Kautz; name: Jane Polak Scowcroft; name: Jared Casper; name: Jimmy Zhang; name: Jinze Xue; name: Jocelyn Huang; name: Joey Conway; name: John Kamalu; name: Jonathan Cohen; name: Joseph Jennings; name: Julien Veron Vialard; name: Junkeun Yi; name: Jupinder Parmar; name: Kari Briski; name: Katherine Cheung; name: Katherine Luna; name: Keith Wyss; name: Keshav Santhanam; name: Kezhi Kong; name: Krzysztof Pawelec; name: Kumar Anik; name: Kunlun Li; name: Kushan Ahmadian; name: Lawrence McAfee; name: Laya Sleiman; name: Leon Derczynski; name: Luis Vega; name: Maer Rodrigues de Melo; name: Makesh Narsimhan Sreedhar; name: Marcin Chochowski; name: Mark Cai; name: Markus Kliegl; name: Marta Stepniewska-Dziubinska; name: Matvei Novikov; name: Mehrzad Samadi; name: Meredith Price; name: Meriem Boubdir; name: Michael Boone; name: Michael Evans; name: Michal Bien; name: Michal Zawalski; name: Miguel Martinez; name: Mike Chrzanowski; name: Mohammad Shoeybi; name: Mostofa Patwary; name: Namit Dhameja; name: Nave Assaf; name: Negar Habibi; name: Nidhi Bhatia; name: Nikki Pope; name: Nima Tajbakhsh; name: Nirmal Kumar Juluru; name: Oleg Rybakov; name: Oleksii Hrinchuk; name: Oleksii Kuchaiev; name: Oluwatobi Olabiyi; name: Pablo Ribalta; name: Padmavathy Subramanian; name: Parth Chadha; name: Pavlo Molchanov; name: Peter Dykas; name: Peter Jin; name: Piotr Bialecki; name: Piotr Januszewski; name: Pradeep Thalasta; name: Prashant Gaikwad; name: Prasoon Varshney; name: Pritam Gundecha; name: Przemek Tredak; name: Rabeeh Karimi Mahabadi; name: Rajen Patel; name: Ran El-Yaniv; name: Ranjit Rajan; name: Ria Cheruvu; name: Rima Shahbazyan; name: Ritika Borkar; name: Ritu Gala; name: Roger Waleffe; name: Ruoxi Zhang; name: Russell J. Hewett; name: Ryan Prenger; name: Sahil Jain; name: Samuel Kriman; name: Sanjeev Satheesh; name: Saori Kaji; name: Sarah Yurick; name: Saurav Muralidharan; name: Sean Narenthiran; name: Seonmyeong Bak; name: Sepehr Sameni; name: Seungju Han; name: Shanmugam Ramasamy; name: Shaona Ghosh; name: Sharath Turuvekere Sreenivas; name: Shelby Thomas; name: Shizhe Diao; name: Shreya Gopal; name: Shrimai Prabhumoye; name: Shubham Toshniwal; name: Shuoyang Ding; name: Siddharth Singh; name: Siddhartha Jain; name: Somshubra Majumdar; name: Stefania Alborghetti; name: Syeda Nahida Akter; name: Terry Kong; name: Tim Moon; name: Tomasz Hliwiak; name: Tomer Asida; name: Tony Wang; name: Twinkle Vashishth; name: Tyler Poon; name: Udi Karpas; name: Vahid Noroozi; name: Venkat Srinivasan; name: Vijay Korthikanti; name: Vikram Fugro; name: Vineeth Kalluru; name: Vitaly Kurin; name: Vitaly Lavrukhin; name: Wasi Uddin Ahmad; name: Wei Du; name: Wonmin Byeon; name: Ximing Lu; name: Xin Dong; name: Yashaswi Karnati; name: Yejin Choi; name: Yian Zhang; name: Ying Lin; name: Yonggan Fu; name: Yoshi Suhara; name: Zhen Dong; name: Zhiyu Li; name: Zhongbo Zhu; name: Zijia Chen
Published: 2025-08-20 06:00:57

Abstract: We introduce Nemotron-Nano-9B-v2, a hybrid Mamba-Transformer language model
designed to increase throughput for reasoning workloads while achieving
state-of-the-art accuracy compared to similarly-sized models.
Nemotron-Nano-9B-v2 builds on the Nemotron-H architecture, in which the
majority of the self-attention layers in the common Transformer architecture
are replaced with Mamba-2 layers, to achieve improved inference speed when
generating the long thinking traces needed for reasoning. We create
Nemotron-Nano-9B-v2 by first pre-training a 12-billion-parameter model
(Nemotron-Nano-12B-v2-Base) on 20 trillion tokens using an FP8 training recipe.
After aligning Nemotron-Nano-12B-v2-Base, we employ the Minitron strategy to
compress and distill the model with the goal of enabling inference on up to
128k tokens on a single NVIDIA A10G GPU (22GiB of memory, bfloat16 precision).
Compared to existing similarly-sized models (e.g., Qwen3-8B), we show that
Nemotron-Nano-9B-v2 achieves on-par or better accuracy on reasoning benchmarks
while achieving up to 6x higher inference throughput in reasoning settings like
8k input and 16k output tokens. We are releasing Nemotron-Nano-9B-v2,
Nemotron-Nano12B-v2-Base, and Nemotron-Nano-9B-v2-Base checkpoints along with
the majority of our pre- and post-training datasets on Hugging Face.