Ministral 3
Authors: name: Alexander H. Liu, name: Kartik Khandelwal, name: Sandeep Subramanian, name: Victor Jouault, name: Abhinav Rastogi, name: Adrien Sadé, name: Alan Jeffares, name: Albert Jiang, name: Alexandre Cahill, name: Alexandre Gavaudan, name: Alexandre Sablayrolles, name: Amélie Héliou, name: Amos You, name: Andy Ehrenberg, name: Andy Lo, name: Anton Eliseev, name: Antonia Calvi, name: Avinash Sooriyarachchi, name: Baptiste Bout, name: Baptiste Rozière, name: Baudouin De Monicault, name: Clémence Lanfranchi, name: Corentin Barreau, name: Cyprien Courtot, name: Daniele Grattarola, name: Darius Dabert, name: Diego de las Casas, name: Elliot Chane-Sane, name: Faruk Ahmed, name: Gabrielle Berrada, name: Gaëtan Ecrepont, name: Gauthier Guinet, name: Georgii Novikov, name: Guillaume Kunsch, name: Guillaume Lample, name: Guillaume Martin, name: Gunshi Gupta, name: Jan Ludziejewski, name: Jason Rute, name: Joachim Studnia, name: Jonas Amar, name: Joséphine Delas, name: Josselin Somerville Roberts, name: Karmesh Yadav, name: Khyathi Chandu, name: Kush Jain, name: Laurence Aitchison, name: Laurent Fainsin, name: Léonard Blier, name: Lingxiao Zhao, name: Louis Martin, name: Lucile Saulnier, name: Luyu Gao, name: Maarten Buyl, name: Margaret Jennings, name: Marie Pellat, name: Mark Prins, name: Mathieu Poirée, name: Mathilde Guillaumin, name: Matthieu Dinot, name: Matthieu Futeral, name: Maxime Darrin, name: Maximilian Augustin, name: Mia Chiquier, name: Michel Schimpf, name: Nathan Grinsztajn, name: Neha Gupta, name: Nikhil Raghuraman, name: Olivier Bousquet, name: Olivier Duchenne, name: Patricia Wang, name: Patrick von Platen, name: Paul Jacob, name: Paul Wambergue, name: Paula Kurylowicz, name: Pavankumar Reddy Muddireddy, name: Philomène Chagniot, name: Pierre Stock, name: Pravesh Agrawal, name: Quentin Torroba, name: Romain Sauvestre, name: Roman Soletskyi, name: Rupert Menneer, name: Sagar Vaze, name: Samuel Barry, name: Sanchit Gandhi, name: Siddhant Waghjale, name: Siddharth Gandhi, name: Soham Ghosh, name: Srijan Mishra, name: Sumukh Aithal, name: Szymon Antoniak, name: Teven Le Scao, name: Théo Cachet, name: Theo Simon Sorg, name: Thibaut Lavril, name: Thiziri Nait Saada, name: Thomas Chabal, name: Thomas Foubert, name: Thomas Robert, name: Thomas Wang, name: Tim Lawson, name: Tom Bewley, name: Tom Bewley, name: Tom Edwards, name: Umar Jamil, name: Umberto Tomasini, name: Valeriia Nemychnikova, name: Van Phung, name: Vincent Maladière, name: Virgile Richard, name: Wassim Bouaziz, name: Wen-Ding Li, name: William Marshall, name: Xinghui Li, name: Xinyu Yang, name: Yassine El Ouahidi, name: Yihan Wang, name: Yunhao Tang, name: Zaccharie Ramzi
Organization: Mistral AI_

We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes: 3B, 8B, and 14B parameters. For each model size, we release three variants: a pretrained base model for general-purpose use, an instruction finetuned, and a reasoning model for complex problem-solving. In addition, we present our recipe to derive the Ministral 3 models through Cascade Distillation, an iterative pruning and continued training with distillation technique. Each model comes with image understanding capabilities, all under the Apache 2.0 license.