How does ChatGPT work? A 5-minute overview
Channel: Inria Flowers
Date: 2024-02-08

This video is an introduction to large language models which are the basis for tools like ChatGPT, Gemini or Mistral. It gives a 5-minute overview answering these questions:
- How are these models “trained”?
- On which type and amount of data are they trained, and what is the impact of the size of the training corpus?
- Which types of tasks are they capable of doing, and how can we ask them to perform those tasks?
- What are their main usages in society?
- What are their limitations and biases? What social issues?
- Which organizations develop these models? Are there “open-sourced” ones?

Chapters:
0:00 : Introduction
0:20 : Language model
1:15 : Training
2:44 : A personality ?
3:43 : Limits of their knowledge
4:06 : Hallucinations
4:23 : Limits
4:42 : Applications
5:01 : Private actors

**** “ChatGPT explained in 5 minutes” series ****
This video is the first episode of a video series (http://developmentalsystems.org/chatgpt_5_minutes/en/)  that presents language models. It is aimed at a large public, students and professors in middle and high school, and more generally anyone not accustomed to computer science or AI.
The other videos of the series :
- What are the limitations of ChatGPT ? : https://youtu.be/7FB1OWPCeyM
- Prompting, or the art of making yourself understood by ChatGPT : https://youtu.be/AscZJQBot2I
- Strengths of language models : COMING SOON
- Advanced prompting, chain of thought reasoning and their limits : COMING SOON


**** Production ****
This video was made by the Inria Flowers team, working in the domain of developmental AI : https://flowers.inria.fr/

The voice was synthesized using ElevenLabs (elevenlabs.io).

Contributors :
-Alexandre Torres–Leguet (Twitter: @AlexandreTL2)
-Clément Romac (@ClementRomac)
-Thomas Carta (@CartaThomas2)
-Pierre-Yves Oudeyer (@pyoudeyer)

**** License ****
This video is distributed under the Creative Commons CC-BY license.

**** Sources ****
- ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html
-flaticon.com was used for icons