Tradition and Innovation

Exploring the Possibility of Educational Data for Sustainable Future
NIER International Symposium on Education Reform, October 28th,2021

Thierry Rocher, IEA Chairwww.iea.nl

Introduction to IEA•••••International Association for the Evaluation of Educational Achievement
Non‐governmental research organization, founded in 1958.
Independent, international cooperative of national research institutions
and governmental research agencies.
Conducts large‐scale comparative studies of educational achievement andother aspects of education.
More than 60 member country institutions, nearly 100 education systems
participate in IEA studies.

IEA members
Armenia
Australia
Austria
Azerbaijan
BahrainBelgium (French)
Belgium (Flemish)
Botswana
BrazilBulgaria
CanadaChile
Chinese Taipei
Colombia
Croatia
CyprusCzech Republic

Denmark
Egypt
Estonia
FinlandFranceGeorgia
Germany
GreeceHong Kong, SAR
Hungary
Indonesia
Iran, Islamic Republic ofIreland
IsraelItaly
Japan
JordanKazakhstan
Korea, Republic of
KuwaitLatviaLithuania
Luxembourg
Malaysia
MexicoMoroccoNetherlands
New Zealand
NorwayOman
Palestine
People’s Republic of China
Philippines
PolandPortugal
Qatar
Republic of North Macedonia
RomaniaRussian FederationSingapore
Slovak Republic
Slovenia
South Africa
Spain
SwedenThailandTurkey
United Arab Emirates
United Kingdom
United States

IEA’s mission•

IEA conducts large‐scale studies to better understand education
practices, processes & policies in order to improve quality teaching &learning within and across systems of education•Linking Research, Policy & Practice•

Reliable data publicly available

Current IEA Studies

Trend data since 1995 Trend data since 2001 Trend data since 2009

Trend data since 2013

IEA Study Design
National, Social andEducational Content

IEA COMPASS BRIEF, SEPTEMBER 2020

INTENDED
Curriculum

School, Teacher and IMPLEMENTEDClassroom Context
Curriculum

Student Outcomes
and Characteristics

ATTAINED
Curriculum

Transition to digitally‐based assessment•••

A global tendency to move from paper‐based to computer‐based
assessments
IEA studies are already well advanced on this path, with the aimof preserving trends while developing innovations, thanks to thetechnology
Hopefully more opportunities than challenges!
Two examples (innovative items and process data analysis)

ICILS: innovative items (example)••International Computerand Information Literacy
Study
Assessing:•Computer and Information
Literacy
Computational thinking

30 countries involved inICILS 2023!

Process data study (example)
Article published inExample of a French math item

Example of a French math item
DataIs there signal
in the noise?

Example of a French math item
Identifying cognitive profiles using Data Science techniques,
within a robust framework in didactics
Structuralapproach, success

Operationalapproach, success

Structuralapproach, failure

Operationalapproach, failure

Process data•••

Need for more evidence, for validation studies
Need for international collaboration
Need for interdisciplinary work
Data collection, storage, analysis
Validity

ReportingLarge‐scale assessments

Research and methods

Item Design

User‐Experience approach (UX)

Theory‐base approach, didactics
Data privacy

Data formats, standards

Psychometrics

Human ‐Computer Interaction (HCI) At the beginning of a promising journey!

Thank you!

Thierry Rocher
thierry.rocher@education.gouv.fr