Gemma 4 Technical Report
Authors: name: Gemma Team, name: Sherif El Abd, name: Vaibhav Aggarwal, name: Robin Algayres, name: Alek Andreev, name: Olivier Bachem, name: Ian Ballantyne, name: Cormac Brick, name: Victor Cărbune, name: Michelle Casbon, name: Mayank Chaturvedi, name: Victor Cotruta, name: Alice Coucke, name: Phil Culliton, name: Robert Dadashi, name: Lucas Dixon, name: Mohamed Elhawaty, name: Utku Evci, name: Clément Farabet, name: Johan Ferret, name: Filippo Galgani, name: Sertan Girgin, name: Jean-Bastien Grill, name: Maarten Grootendorst, name: Jiaxian Guo, name: Cassidy Hardin, name: Yanzhang He, name: Steven M. Hernandez, name: Omri Homburger, name: Léonard Hussenot, name: Juyeong Ji, name: Armand Joulin, name: Aishwarya Kamath, name: Parnian Kassraie, name: Olivier Lacombe, name: Preethi Lahoti, name: Gaël Liu, name: Gus Martins, name: Luciano Martins, name: Tatiana Matejovicova, name: Ramona Merhej, name: Nikola Momchev, name: Sneha Mondal, name: Ryan Mullins, name: Sindhu Raghuram Panyam, name: Shreya Pathak, name: Sarah Perrin, name: André Susano Pinto, name: Etienne Pot, name: Angéline Pouget, name: Alexandre Ramé, name: Sabela Ramos, name: Douglas Reid, name: David Rim, name: Morgane Rivière, name: Karsten Roth, name: Louis Rouillard, name: Omar Sanseviero, name: Pier Giuseppe Sessa, name: Shane Settle, name: Danila Sinopalnikov, name: Sara Smoot, name: Piotr Stanczyk, name: Andreas Steiner, name: Lawrence Stewart, name: Ilya Tolstikhin, name: Michael Tschannen, name: Anton Tsitsulin, name: Nino Vieillard, name: Renjie Wu, name: Pingmei Xu, name: Haichuan Yang, name: Edouard Yvinec, name: Li Zhang, name: Joe Zou, name: Nicolas Aagnes, name: Abdelrahman Abdelhamed, name: Shivani Agrawal, name: Shubham Agrawal, name: Ibrahim Alabdulmohsin, name: Jean Baptiste Alayrac, name: Uri Alon, name: Chandramouli Amarnath, name: Ankesh Anand, name: Chrysovalantis Anastasiou, name: Setareh Ariafar, name: François-Xavier Aubet, name: Kyriakos Axiotis, name: Federico Barbero, name: Joelle Barral, name: Alexei Bendebury, name: Urs Bergmann, name: Stanley Bileschi, name: Kat Black, name: Mathieu Blondel, name: Sebastian Borgeaud, name: Arthur Bražinskas, name: Ryan Burnell, name: Robert Busa-Fekete, name: Mu Cai, name: Glenn Cameron, name: Charlotte Caucheteux, name: Garima Chadha, name: Jetha Chan, name: Aditya Chawla, name: Blake Jianhang Chen, name: Jesse Chen, name: Lin Chen, name: Xu Chen, name: Derek Cheng, name: Tzu-hsiang Chien, name: Nikolai Chinaev, name: Yi Chou, name: Zhaohui Chu, name: Benjamin Coleman, name: Pooja Consul, name: Sam Conway-Rahman, name: Scott Crowell, name: Dylan Cutler, name: Vivek Dani, name: Samira Daruki, name: Anil Das, name: Daniel Deutsch, name: Nishanth Dikkala, name: Li Ding, name: Qiuhan Ding, name: Shenil Dodhia, name: Konstantin Donhauser, name: Tulsee Doshi, name: Anca Dragan, name: Alex Druinsky, name: Sahil Dua, name: Zoltan Egyed, name: Danielle Eisenbud, name: Daniel Eppens, name: Cindy Fan, name: Bahare Fatemi, name: Yassir Fathullah, name: Vlad Feinberg, name: Milen Ferev, name: Takumi Fujimoto, name: Isaac Galatzer-Levy, name: João Gante, name: Simon Geisler, name: Soham Ghosal, name: Antonious M. Girgis, name: Alec Go, name: Alhaad Gokhale, name: Alex Grills, name: Yiming Gu, name: Pramod Gupta, name: Guru Guruganesh, name: Raia Hadsell, name: Hamza Harkous, name: Jitendra Harlalka, name: Demis Hassabis, name: Anja Hauth, name: Joe Heyward, name: Arian Hosseini, name: Chih-Yang Hsia, name: I-Hung Hsu, name: Xiaopeng Huang, name: Yangsibo Huang, name: Kevin Hui, name: Adrian Hutter, name: Te I, name: Fotis Iliopoulos, name: Advait Jain, name: Ganesh Jawahar, name: Ziwei Ji, name: Qilin Jin, name: Melvin Johnson, name: Kandarp Joshi, name: Arun Kandoor, name: Wang-Cheng Kang, name: Koray Kavukcuoglu, name: Mehran Kazemi, name: Kathleen Kenealy, name: Amr Khalifa, name: Phoebe Kirk, name: Suraj Kothawade, name: Vitaly Kovalev, name: Neel Kovelamudi, name: Adam Kraft, name: Ravin Kumar, name: Harish Kuppam, name: Justin Lannin, name: Chen-Yu Lee, name: Seungji Lee, name: Dmitry Lepikhin, name: Dongdong Li, name: Qiujia Li, name: Valentin Liévin, name: Ethan Lin, name: Ziqian Lin, name: Casper Liu, name: Tianlin Liu, name: Tianqi Liu, name: Xin Liu, name: Mayank Lunayach, name: Min Ma, name: Gagan Madan, name: Andrii Maksai, name: Eric Malmi, name: Michal Matuszak, name: Daniel McDuff, name: Gaurav Menghani, name: Daniil Mirylenka, name: Karolis Misiunas, name: Vedant Misra, name: Andreea Mitran, name: Kareem Mohamed, name: Maksim Mukha, name: Eric Noland, name: James O'Donnell, name: Kate Olszewska, name: Bernett Orlando, name: Wanqiong Pan, name: Rina Panigrahy, name: Unnati Parekh, name: Chunjong Park, name: Eric Paskie, name: Liqian Peng, name: Bryce Petrini, name: Slav Petrov, name: Jonas Pfeiffer, name: Bilal Piot, name: Martyna Plomecka, name: Siim Poder, name: Octavio Ponce, name: Arijit Pramanik, name: David Racz, name: Anish Rajan, name: Michelle Ramanovich, name: Anand Rao, name: Marvin Ritter, name: Vitor Rodrigues, name: Evan Rosen, name: Mikołaj Rybiński, name: Noveen Sachdeva, name: Michaël E. Sander, name: Rohit Sathyanarayana, name: Sagar Savla, name: Samuel Schmidgall, name: Tal Schuster, name: Benoit Seguin, name: Andrew Sellergren, name: Aliaksei Severyn, name: Izhak Shafran, name: Dhruv Shah, name: Yuan Shangguan, name: Ashish Shenoy, name: Pradeep Shenoy, name: Rakesh Shivanna, name: Pauline Sho, name: Lucas Spangher, name: Wojciech Stokowiec, name: Tim Strother, name: Yao Su, name: Yinghao Sun, name: Mukund Sundararajan, name: Andrea Tacchetti, name: Mor Hazan Taege, name: Pouya Tafti, name: Chetan Tekur, name: Rahul Thapa, name: Madeleine Traverse, name: Lenart Treven, name: Tao Tu, name: Chien Te Tung, name: Petar Veličković, name: Malini Pooni Venkat, name: Sagar Gubbi Venkatesh, name: Vidya Venkiteswaran, name: Francesco Visin, name: Alex Vitvitskyi, name: Kiran Vodrahalli, name: Weiyi Wang, name: Xin Wang, name: Tris Warkentin, name: Jan Wassenberg, name: John Wieting, name: Lechao Xiao, name: Hao Xu, name: Yuhui Xu, name: Fuzhao Xue, name: Arun Yadav, name: Jun Yan, name: Antoine Yang, name: Lin Yang, name: Ming-Hsuan Yang, name: Ziyu Ying, name: Jae Hyeon Yoo, name: Sajjad Zafar, name: Fred Zhang, name: Jiageng Zhang, name: Jianyi Zhang, name: Xiaofan Zhang, name: Chao Zhao, name: David Zhou, name: Chen Zou
Organization: Google

We introduce Gemma 4, a new generation of open-weight, natively multimodal language models in the Gemma model family. Designed to advance compute efficiency and reasoning, the Gemma 4 model suite features dense and Mixture-of-Experts architectures, ranging from 2.3B to 31B parameters. Alongside improved vision and audio encoders for all model sizes, we propose a unified, encoder-free architecture for our 12B model, which ingests raw audio and image patches. Furthermore, we integrate a thinking mode, enabling Gemma models to generate reasoning traces prior to responding. We improve inference speed, memory, and compute efficiency, as well as long-context abilities through critical design choices. Gemma 4 establishes a leap in performance across STEM, multimodal, and long-context benchmarks, and rivals larger, frontier open models in human-rated tasks.