Gemini Robotics: Bringing AI into the Physical World
Authors: name: Gemini Robotics Team, name: Saminda Abeyruwan, name: Joshua Ainslie, name: Jean-Baptiste Alayrac, name: Montserrat Gonzalez Arenas, name: Travis Armstrong, name: Ashwin Balakrishna, name: Robert Baruch, name: Maria Bauza, name: Michiel Blokzijl, name: Steven Bohez, name: Konstantinos Bousmalis, name: Anthony Brohan, name: Thomas Buschmann, name: Arunkumar Byravan, name: Serkan Cabi, name: Ken Caluwaerts, name: Federico Casarini, name: Oscar Chang, name: Jose Enrique Chen, name: Xi Chen, name: Hao-Tien Lewis Chiang, name: Krzysztof Choromanski, name: David D'Ambrosio, name: Sudeep Dasari, name: Todor Davchev, name: Coline Devin, name: Norman Di Palo, name: Tianli Ding, name: Adil Dostmohamed, name: Danny Driess, name: Yilun Du, name: Debidatta Dwibedi, name: Michael Elabd, name: Claudio Fantacci, name: Cody Fong, name: Erik Frey, name: Chuyuan Fu, name: Marissa Giustina, name: Keerthana Gopalakrishnan, name: Laura Graesser, name: Leonard Hasenclever, name: Nicolas Heess, name: Brandon Hernaez, name: Alexander Herzog, name: R. Alex Hofer, name: Jan Humplik, name: Atil Iscen, name: Mithun George Jacob, name: Deepali Jain, name: Ryan Julian, name: Dmitry Kalashnikov, name: M. Emre Karagozler, name: Stefani Karp, name: Chase Kew, name: Jerad Kirkland, name: Sean Kirmani, name: Yuheng Kuang, name: Thomas Lampe, name: Antoine Laurens, name: Isabel Leal, name: Alex X. Lee, name: Tsang-Wei Edward Lee, name: Jacky Liang, name: Yixin Lin, name: Sharath Maddineni, name: Anirudha Majumdar, name: Assaf Hurwitz Michaely, name: Robert Moreno, name: Michael Neunert, name: Francesco Nori, name: Carolina Parada, name: Emilio Parisotto, name: Peter Pastor, name: Acorn Pooley, name: Kanishka Rao, name: Krista Reymann, name: Dorsa Sadigh, name: Stefano Saliceti, name: Pannag Sanketi, name: Pierre Sermanet, name: Dhruv Shah, name: Mohit Sharma, name: Kathryn Shea, name: Charles Shu, name: Vikas Sindhwani, name: Sumeet Singh, name: Radu Soricut, name: Jost Tobias Springenberg, name: Rachel Sterneck, name: Razvan Surdulescu, name: Jie Tan, name: Jonathan Tompson, name: Vincent Vanhoucke, name: Jake Varley, name: Grace Vesom, name: Giulia Vezzani, name: Oriol Vinyals, name: Ayzaan Wahid, name: Stefan Welker, name: Paul Wohlhart, name: Fei Xia, name: Ted Xiao, name: Annie Xie, name: Jinyu Xie, name: Peng Xu, name: Sichun Xu, name: Ying Xu, name: Zhuo Xu, name: Yuxiang Yang, name: Rui Yao, name: Sergey Yaroshenko, name: Wenhao Yu, name: Wentao Yuan, name: Jingwei Zhang, name: Tingnan Zhang, name: Allan Zhou, name: Yuxiang Zhou

Recent advancements in large multimodal models have led to the emergence of
remarkable generalist capabilities in digital domains, yet their translation to
physical agents such as robots remains a significant challenge. This report
introduces a new family of AI models purposefully designed for robotics and
built upon the foundation of Gemini 2.0. We present Gemini Robotics, an
advanced Vision-Language-Action (VLA) generalist model capable of directly
controlling robots. Gemini Robotics executes smooth and reactive movements to
tackle a wide range of complex manipulation tasks while also being robust to
variations in object types and positions, handling unseen environments as well
as following diverse, open vocabulary instructions. We show that with
additional fine-tuning, Gemini Robotics can be specialized to new capabilities
including solving long-horizon, highly dexterous tasks, learning new
short-horizon tasks from as few as 100 demonstrations and adapting to
completely novel robot embodiments. This is made possible because Gemini
Robotics builds on top of the Gemini Robotics-ER model, the second model we
introduce in this work. Gemini Robotics-ER (Embodied Reasoning) extends
Gemini's multimodal reasoning capabilities into the physical world, with
enhanced spatial and temporal understanding. This enables capabilities relevant
to robotics including object detection, pointing, trajectory and grasp
prediction, as well as multi-view correspondence and 3D bounding box
predictions. We show how this novel combination can support a variety of
robotics applications. We also discuss and address important safety
considerations related to this new class of robotics foundation models. The
Gemini Robotics family marks a substantial step towards developing
general-purpose robots that realizes AI's potential in the physical world.