ERA scoreboard 2023.
Date: 2024-03-26
Institutions: Directorate-General for Research and Innovation
Subjects: EU Member State, benchmarking, comparative analysis, economic indicator, economic sector, innovation, performance measurement, report, research and development, small and medium-sized enterprises

ERA Scoreboard 2023 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ERA Scoreboard 2023 

European Commission 
Directorate-General for Research and Innovation 
Directorate A - ERA & Innovation  
Unit A.2 - ERA, Spreading Excellence and Research Careers 
Contact   Manuel Aleixo, Head of Unit A.2 
Heiko Prange-Gstoehl 
Marlene Schoder-Kienbeck 
RTD-ERA-FORUM@ec.europa.eu  
RTD-PUBLICATIONS@ec.europa.eu 

Email  

European Commission 
B-1049 Brussels 

Manuscript completed in November 2023  

The European Commission shall not be liable for any consequence stemming from the reuse. 

PDF  

ISBN 978-92-68-07544-9 

doi:10.2777/674915 

KI-04-23-857-EN-N 

Luxembourg: Publications Office of the European Union, 2024 

© European Union, 2024 

The reuse policy of European Commission documents is implemented by Commission Decision 2011/833/EU 
of 12 December 2011 on the reuse of Commission documents (OJ L 330, 14.12.2011, p. 39). Unless otherwise 
noted, the reuse of this document is authorised under a Creative Commons Attribution 4.0 International (CC 
BY 4.0) licence (https://creativecommons.org/licenses/by/4.0/). This means that  reuse is allowed  provided 
appropriate credit is given and any changes are indicated. 

For any use or reproduction of elements that are not owned by the European Union, permission may need to 
be sought directly from the respective rightholders. The European Union does not own the copyright in relation 
to the following elements: 
Image credits for cover page and throughout: © skypicsstudio # 286372753, © MicroOne # 288703015,  
©  creativeteam  #  323412491,  ©  Viktoriia  #  345410470,  ©  Yurii  #  372950117,  2022.  Source: 
Stock.Adobe.com. 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
EUROPEAN COMMISSION 

ERA Scoreboard 2023 

This report was prepared by 

Hugo Hollanders and Aishe Khalilova (Maastricht University / UNU-MERIT) 

as part of ‘Development of the ERA Scoreboard, the ERA Dashboard and the Regular Reports’ 
project for the European Commission, Directorate-General for Research and Innovation under                   

Framework Contract N° 2018/RTD/A2/OP/PP-07001-2018 Lot 2 (EDAR) 

2024 

Directorate-General for Research and Innovation 

EN 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Table of contents 

1. 

2. 

3. 

4. 

5. 

EXECUTIVE SUMMARY ........................................................ 5 

RÉSUMÉ EXÉCUTIF .............................................................. 6 

OVERVIEW OF THE PURPOSE AND CONTENT OF THE 
REPORT ................................................................................. 7 

SUMMARY OF ERA SCOREBOARD PERFORMANCE ....... 13 

PERFORMANCE BY ERA SCOREBOARD INDICATOR ...... 15 

General indicators ................................................................................ 16 

5.1.1.  Gross Domestic Expenditure on R&D as a percentage of GDP 

5.1.2. 

Researchers (in full-time equivalent) per million inhabitants 

16 

19 

Deepening a truly functioning internal market for knowledge ........ 21 

5.2.1. 

5.2.2. 

Share of publications available in open access 

Share of women in grade A positions in higher education 

21 

23 

5.2.3. 

Job-to-job mobility of Human Resources in Science & Technology  25 

5.2.4. 

5.2.5. 

5.2.6. 

5.3.1. 

5.3.2. 

5.3.3. 

Share of innovating firms collaborating with HEI/PRO out of all 
innovative firms 

Number of scientific publications among the top-10% most cited 
publications worldwide as a percentage of all publications 

International co-publications with non-EU partners per million 
population 

27 

29 

31 

Taking up together the green transition and digital transformation and 
other  challenges  with  impact  on  society,  and  increasing  society’s 
participation in the ERA ....................................................................... 34 

Environmentally related government R&D budget as % of total 
government R&D 

Share of researchers receiving transferable skills training 

Direct government support and Indirect government support 
through R&D tax incentives as a percentage of GDP 

34 

36 

38 

5.3.4. 

Scientific publications on social innovation per million population  40 

Enhancing access to research and innovation excellence across the 
innovation 
Union  and  enhancing 
ecosystems across the Union ............................................................. 42 

inter-connections  between 

5.4.1. 

Increase in total R&D expenditure, expressed as a percentage of 
GDP 

42 

2 

 
 
 
 
 
Advancing  concerted  research  and  innovation  investments  and 
reforms................................................................................................... 44 

5.5.1. 

5.5.2. 

Share of public R&D expenditures financed by the private sector 

Government budget allocations for R&D allocated to Europe-wide 
transnational, as well as bilateral or multilateral, public R&D 
programmes per FTE researcher 

44 

46 

6. 

 RESULTS  FOR  HORIZON  EUROPE  ASSOCIATED 
COUNTRIES ........................................................................... 48 

Armenia ................................................................................................. 49 

Georgia .................................................................................................. 49 

Iceland ................................................................................................... 49 

Israel....................................................................................................... 49 

Montenegro ........................................................................................... 49 

Norway ................................................................................................... 50 

Serbia ..................................................................................................... 50 

Türkiye ................................................................................................... 50 

7. 

CONCLUSIONS ...................................................................... 51 

ANNEXES  SHOWING  LATEST 
INDICATOR  VALUES  AND 
CHANGES OVER TIME FOR EACH OF THE ERA-SCOREBOARD 
INDICATORS ...................................................................................... 52 

Annex 1 Gross Domestic Expenditure on R&D as a percentage of GDP ..... 52 

Annex 2 Researchers (in full-time equivalent) per million inhabitants ......... 53 

Annex 3 Share of publications available in open access ............................... 54 

Annex 4 Share of women in grade A positions in higher education ............. 55 

Annex  5  Job-to-job  mobility  of  Human  Resources  in  Science & Technology
 .......................................................................................................................... 56 

Annex  6  Share  of  innovating  firms  collaborating  with  HEI/PRO  out  of  all 
innovative firms .............................................................................................. 57 

Annex  7  Number  of  scientific  publications  among  the  top-10%  most  cited 
publications worldwide as a percentage of all publications ..................... 58 

Annex  8  International  co-publications  with  non-EU  (or  foreign)  partners  per 
million population ........................................................................................... 59 

Annex 9 Environmentally related government R&D budget as percentage of 
total government R&D ................................................................................... 60 

Annex 10 Share of researchers receiving transferable skills training .......... 61 

3 

 
 
 
 
 
 
 
 
 
 
Annex  11  Direct  government  support  and  Indirect  government  support 
through R&D tax incentives as a percentage of GDP ................................ 62 

Annex 12 Research on social innovation per million population .................. 63 

Annex  13  Increase  in  total  R&D  expenditure,  expressed  as  a  percentage  of 
GDP .................................................................................................................. 64 

Annex  14  Share  of  public  R&D  expenditures  financed  by  the  private  sector
 .......................................................................................................................... 65 

Annex 15 Government budget allocations for R&D allocated to Europe-wide 
transnational, as well as bilateral or multilateral, public R&D programmes 
per FTE researcher ......................................................................................... 66 

Annex 16 Country abbreviations ....................................................................... 67 

4 

 
 
 
 
1.  Executive summary 

The ERA (European Research Area) Scoreboard is one of the components of the new ERA 
Monitoring Mechanism, covering 18 indicators, including two  general indicators measuring 
progress in the European Research & Innovation (R&I)  system and 16 specific indicators, 
one for each Pact for R&I priority. 

The ERA Scoreboard monitors progress towards the ERA objectives at Union level. Of the 
18  indicators  included  in  the  measurement  framework,  currently  data  are  available  for  15 
indicators, for two indicators the construction of the data using the Horizon Dashboard and 
the Cordis Datalab are being explored, and for one indicator data are not available. 

The  careful  selection  of  indicators  -  based  on  data  availability  -  and  the  calculation  and 
presentation of the data is key to derive any solid policy conclusions and to monitor progress 
on the overall ERA objectives in a credible manner. 

For each of the indicators, a trend performance at EU level has been evaluated for three time 
periods, from 2010 to present, from 2015 to present, and for the last three years. Based on 
the number of times the trend was positive in each of these periods, an indicator is considered 
to  have  shown  substantial  positive  change,  slower  positive  change,  or  little  to  no  positive 
change. 

The results of the ERA Scoreboard 2023 show that for the EU there has been substantial 
positive change in the following Pact for R&I priorities: R&D investments; Gender equality; 
Global  engagement;  Synergies  with  sectorial  policies  and 
industrial  policies;  and 
Coordination of R&I investments. 

The  EU  has  shown  slower  positive  change  in  the  following  Pact  for  R&I  priorities: 
Researchers’ careers and mobility; Knowledge Valorisation; and Active citizen and societal 
engagement in R&I. 

The EU has shown limited positive change in the following Pact for R&I priorities: Scientific 
leadership; Challenge-based ERA actions; Synergies with education and the European Skills 
Agenda; More investments and reforms in countries and regions with lower R&I performance; 
and Support to prioritise and secure long-term R&I investments and policy reforms. 

While considering the challenges attached to the indicators and the related data, the results 
indicate that still some additional effort would be beneficial mainly in the priority areas where 
“limited positive change” can be observed. These preliminary results need to be scrutinised 
by future Scoreboards, but might also be reflected in the future ERA Policy Agendas. 

5 

 
 
 
 
2.  Résumé exécutif 

Le tableau de bord de l'EER (Espace européen de la recherche) est l'une des composantes 
du nouveau mécanisme de suivi de l'EER, couvrant au maximum 18 indicateurs, dont deux 
indicateurs  généraux  mesurant  les  progrès  du  système  européen  de  recherche  et 
d'innovation et 16 indicateurs spécifiques, un pour chaque priorité du Pacte pour la R&I. 

Le tableau de bord de l'EER suit les progrès réalisés vers la réalisation des objectifs de l'EER 
au niveau de l'Union. Sur les 18 indicateurs inclus dans le cadre de mesure, les données 
sont  actuellement  disponibles  pour  15  indicateurs,  pour  2  indicateurs,  la  construction  des 
données à l'aide du Horizon Dashboard et du Cordis Datalab est en cours d'exploration, et 
pour 1 indicateur, les données ne sont pas disponibles. 

La sélection rigoureuse des indicateurs - sur la base de la disponibilité des données - ainsi 
que  le  calcul  et  la  présentation  des  données  sont  essentiels  pour  tirer  des  conclusions 
politiques solides et pour suivre de manière crédible les progrès accomplis dans la réalisation 
des objectifs globaux de l’EER. 

Pour chacun des indicateurs, une performance tendancielle au niveau de l'UE a été évaluée 
sur  trois  périodes,  de  2010  à  aujourd'hui,  de  2015  à  aujourd'hui  et  sur  les  trois  dernières 
années. En fonction du nombre de fois où la tendance a été positive au cours de chacune 
de  ces  périodes,  un  indicateur  est  considéré comme  ayant  montré  un  changement  positif 
substantiel, un changement positif plus lent ou peu ou pas de changement positif. 

Les résultats du tableau de bord de l'EER 2023 montrent que pour l'UE, des changements 
« positifs substantiels » ont été constatés dans les priorités suivantes du Pacte en matière 
de R&I: investissements en R&D; Égalité des sexes; Engagement mondial; Synergies avec 
les politiques sectorielles et les politiques industrielles; et Coordination des investissements 
en R&I. 

L’UE a montré des changements « positifs plus lents » dans les priorités suivantes du Pacte 
pour  la  R&I:  carrières  et  mobilité  des  chercheurs;  Valorisation  des  connaissances;  et 
Engagement citoyen actif et sociétal dans la R&I. 

L’UE n’a montré des changements « positifs limités » dans les priorités suivantes du Pacte 
pour  la  R&I:  leadership  scientifique;  Actions  ERA  basées  sur  des  défis;  Synergies  avec 
l'éducation  et 
la  stratégie  européenne  en  matière  de  compétences;  Davantage 
d’investissements et de réformes dans les pays et régions ayant de faibles performances en 
R&I;  et  Soutien  pour  prioriser  et  sécuriser  les  investissements  en  R&I  et  les  réformes 
politiques à long terme. 

Si  l’on  tient  compte  des  défis  liés  aux  indicateurs  et  aux  données  qui  s’y  rapportent,  les 
résultats  indiquent  qu’un  effort  supplémentaire  serait  bénéfique,  principalement  dans  les 
domaines  prioritaires  où  l’on  peut  observer  des  changements  « positifs  limités  ».  Ces 
résultats préliminaires doivent être examinés à la loupe dans le cadre des futurs tableaux de 
bord, mais ils pourraient également être pris en compte dans les futurs programmes d’action 
de l’EER (ERA Policy Agenda). 

6 

 
 
 
 
3.  Overview of the purpose and content of the report 

The report provides the results of the ERA Scoreboard 2023. As requested in the Pact for 
Research and Innovation, the ERA Scoreboard “should assess the overall consolidation and 
collective progress of ERA priorities and should only display aggregated data at EU level”.1 
Time  series  allow  to  monitor  progress  over  time.  In  addition,  the  ERA  Scoreboard  2023 
includes  metrics  for most  indicators  showing  if  performance  on  each  of  the indicators  has 
been converging or diverging across Member States. 

The ERA Scoreboard 2023 applies 18 indicators2, including two general indicators measuring 
progress in the European R&I system and 16 specific indicators, one for each Pact for R&I 
priority. The indicators are shown in Table 1 below, including information on the source of the 
data.3 

The indicators applied for the ERA Scoreboard 2023 use, as much as possible, data from 
publicly available data sources. Indicators are as timely as possible, so they reflect recent 
changes in policies. Indicators and data will be regularly checked for updates to ensure an 
annual update of the Scoreboard. The first two indicators in the ERA Scoreboard 2023 are 
not directly linked to Pact priorities but are considered important to measure overall progress 
in the European R&I system. For most indicators, time series data are available. The table 
also includes information on the timeliness of the data. 

For most of the indicators, most recent data would be for 2019, 2020 or 2021. Table 1 also 
includes information for which Member States data are available. For some indicators, data 
are not available for all Member States and for these, the EU aggregate is constructed using 
a  smaller  group  of  countries.  The  last  column  includes  a  short  rationale  why  each  of  the 
indicators is included in the ERA Scoreboard 2023.4 

1 https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=COM:2021:407:FIN  

2 In the ERA Scorebord 2023, there was no data available for indicators 4, 15 and 16 in a form 
that  would  have  been  required  to  meanigfully  project  these  indicators.  The  ERA  Scoreboard 
Methodology Report provides information on what kind of data and calculations would have been 
necessary.  In  view  of  the  2024  monitoring  cycle,  the  Commission  will  present  a  report  on  the 
refinement of the indicator framework incorporating recommendations on how to fill the indicator 
and/or data gaps that have been identified in the 2023 ERA monitoring. This report will be brought 
to  the  attention  of  the  ERA  Forum  for  further  consideration.  For  all  monitoring  reports,  please 
consult the ERA Policy Platform. 

3  For more  details on  the indicators,  their selection  and  caveats,  please  see  “ERA  Scoreboard 
2023 - Methodology Report”. 

4 See “Data gathering and analysis of policy developments and reforms: Study to evaluate the 
ERA  policy  framework/ERA  monitoring  mechanism”  (https://op.europa.eu/en/publication-detail/-
/publication/98a8edb4-c763-11ec-b6f4-01aa75ed71a1/language-en/format-PDF/source-
256243590). 

7 

 
 
Table 1: Indicators included in the ERA Scoreboard 2023 

ERA Scoreboard 
indicator 

ERA Pact sub-
priorities 

Source 

Time 
series 

Fre-
quency 

Most 
recent 

Member 
States 

Rationale 

1  Gross Domestic 

R&D Investment  Eurostat (variable 

Yes 

Annual 

2021 

All 

Monitors progress towards the 3% R&D target 

Expenditure on R&D 
(GERD) as a percentage 
of GDP 

rd_e_gerdtot) 

2  Researchers (in full-time 

R&D Investment  Eurostat (variable 

Yes 

Annual 

2021 

All 

equivalent) per million 
inhabitants 

rd_p_persocc) 

Deepening a truly functioning internal market for knowledge 

3  Share of publications 

Open Science 

OpenAIRE 

Yes 

Annual 

2021 

All 

Research infra-
structures 

Not available 

n/a 

n/a 

n/a 

n/a 

available in open access 

4  Share of national public 
R&D expenditure 
committed to joint 
programmes and 
initiatives, research 
infrastructures and 
European Partnerships 

5  Share of women in grade 
A positions in higher 
education institutes 

Direct measure of the number of R&D workers 
per 1 million people. It is identical to UN SDG 
indicator 9.5.2 

Measures share of publications available in 
open access 

Included in the ERA Pact ("Member States 
take note of the Commission’s proposals to 
include ... two new voluntary targets for 
Member States to commit 5 % of national 
public R&D funding to joint programmes and 
European Partnerships by 2030") 

Gender Equality  Women in Science 

Yes 

database 

Multi-
annual 

2018 

All 

Tracks progress in the participation of women 
in the highest levels of academia 

6 

Job-to-job mobility of 
Human Resources in 
Science & Technology 

Researchers’ 
careers and 
mobility 

Eurostat (variable 
hrst_fl_mobsex) 

Yes 

Annual 

2020 

All 

Measures the exchange of knowledge resulting 
from people moving between one job and 
another. Not all changes in jobs include the 
creation of knowledge or the diffusion of 
knowledge, but it is more likely that knowledge 
creation and diffusion takes place when more 
employees move between jobs 

8 

 
  
  
ERA Scoreboard 
indicator 

ERA Pact sub-
priorities 

Source 

Time 
series 

Fre-
quency 

Most 
recent 

Member 
States 

Rationale 

Knowledge 
Valorisation 

Eurostat: Community 
Innovation Survey 

Yes 

Biennial  2020 

All 

Scientific 
leadership 

Web of Science or 
Scopus 

Yes 

Annual 

2019 

All 

7  Share of innovating firms 

collaborating with 
HEI/PRO out of all 
innovative firms 

8  Number of scientific 

publications among the 
top-10% most cited 
publications worldwide as 
a percentage of all 
publications 

9 

International co-
publications with non-EU 
partners per 1,000 
researchers in the public 
sector 

Global 
engagement 

Scopus and Eurostat 

Yes 

Annual 

2021 

No 

Measures the collaboration and thus exchange 
of knowledge between the business and public 
sector 

Measure for scientific impact and relevance of 
the scientific publications, as highly cited 
publications are assumed to be more relevant 
and have a higher scientific impact. There 
could be a bias towards small or English-
speaking countries given the coverage of 
Scopus’ publication data. 

International scientific co-publications are a 
proxy for the quality of scientific research as 
collaboration increases scientific productivity. 
Non-EU is defined as non-EU Member States 

Taking up together the green transition and digital transformation and other challenges with impact on society, and increasing society’s participation in the ERA 

10  Environmentally related 

government R&D budget 
as percentage of total 
government R&D 

Challenge-based 
ERA actions 

OECD Green Growth 
Indicators Database: 
https://stats.oecd.org/In
dex.aspx?DataSetCode
=GREEN_GROWTH 

Yes 

Annual 

2020 

11  Share of researchers 
receiving transferable 
skills training 

Synergies with 
education and the 
European Skills 
Agenda 

MORE Survey 
(https://www.more-
4.eu/online-indicator-
tool) 

No 
(data 
for 2016 
& 2019) 

Irregular  2019 

23 MS 
(no data 
for BG, 
CY, HR, 
MT) 

24 MS 
(no data 
for CY, 
EL, MT) 

Monitors progress on research activities 
supporting the EU Green deal 

Measures the extent of formal and information 
training received by PhD students 

9 

 
  
 
ERA Scoreboard 
indicator 

ERA Pact sub-
priorities 

Source 

Time 
series 

Fre-
quency 

Most 
recent 

Member 
States 

Rationale 

12  Direct government 

support and Indirect 
government support 
through R&D tax 
incentives as a 
percentage of GDP 

Synergies with 
sectorial policies 
and industrial 
policies 

Eurostat for data on 
direct support 

OECD R&D Tax 
Incentive Database 
(http://oe.cd/rdtax) for 
data on indirect support 

Yes 

Annual 

2019 

22 MS 
(no data 
for BG, 
CY, DE, 
EE, LU) 

Public financing of R&D can take two forms: 
Direct funding for R&D through instruments 
such as grants and public procurement, and 
Indirect support through the tax system. Over 
time, more and more countries have 
introduced R&D tax incentives 

13  Publications on social 
innovation per million 
population 

Active citizen and 
societal 
engagement in 
R&I 

OpenAIRE 

Yes 

Annual 

2021 

All 

Captures contributions from public and private 
sector R&I towards solving societal problems 

Enhancing access to research and innovation excellence across the Union and enhancing interconnections between innovation ecosystems across the Union 

14 

Increase in total R&D 
expenditure, expressed 
as a percentage of GDP 

More investments 
and reforms in 
countries and 
regions with lower 
R&I  
performance 

Eurostat (variable 
d_e_gerdtot) 

Yes 

Annual 

2020 

No 

Monitors widening countries' share in EU 
research activities 

Widening countries include Bulgaria, Croatia, 
Cyprus, Czechia, Estonia, Greece, Hungary, 
Latvia, Lithuania, Malta, Poland, Portugal, 
Romania, Slovakia, Slovenia 

10 

 
  
 
ERA Scoreboard 
indicator 

15  Share of Seal of 

Excellence rewards that 
received funding from 
other sources 

ERA Pact sub-
priorities 

Synergies 
between Union, 
national and 
regional funding 
programmes 

Source 

Time 
series 

Fre-
quency 

Most 
recent 

Member 
States 

Rationale 

n/a 

n/a 

n/a 

Aggre-
gate for 
multiple 
years 

Not available 

Horizon Dashboard: 
https://ec.europa.eu/info
/funding-
tenders/opportunities/po
rtal/screen/opportunities
/horizon-dashboard 

The Seal of Excellence is a quality label 
awarded by the Commission to proposals 
which have been assessed in a call for 
proposals under a Union instrument and are 
deemed to comply with the quality 
requirements of that Union instrument but 
could not be funded due to budgetary 
constraints 

These projects are judged to deserve funding 
and might receive support from other Union or 
national sources of funding. The Seal of 
Excellence certificate recognises the value of 
the proposal and helps other funding bodies 
take advantage of the high-quality Commission 
evaluation process 

16  Number of collaboration 
networks of RPOs in 
Widening countries with 
other EU countries 

Increased 
collaborative links 
and excellence-
based integration 
of research-
performing 
organisations 
from countries 
and regions with 
lower R&I 
performance 

Not available 

CORDIS Datalab 
(https://cordis.europa.eu
/datalab/datalab.php) 

Aggre-
gate for 
multiple 
years 

n/a 

n/a 

n/a 

Monitors the number of collaborations between 
Widening countries and other EU countries 

Widening countries include Bulgaria, Croatia, 
Cyprus, Czechia, Estonia, Greece, Hungary, 
Latvia, Lithuania, Malta, Poland, Portugal, 
Romania, Slovakia, Slovenia 

Advancing concerted research and innovation investments and reforms 

11 

 
  
 
ERA Scoreboard 
indicator 

ERA Pact sub-
priorities 

Source 

Time 
series 

Fre-
quency 

Most 
recent 

Member 
States 

Rationale 

Support to 
prioritise and 
secure long-term 
R&I investments 
and policy 
reforms 

Coordination of 
R&I investments 

17  Share of public R&D 

expenditures financed by 
the private sector 

18  Government budget 
allocations for R&D 
(GBARD) allocated to 
Europe-wide 
transnational, as well as 
bilateral or multilateral, 
public R&D programmes 
per FTE researcher 

Eurostat (variable 
rd_e_gerdfund) 

Yes 

Annual 

2020 

All 

Eurostat (variables 
gba_tncoor & 
rd_p_persocc) 

Yes 

Annual 

2020 

All 

Measures public-private co-operation in 
research. The willingness of the private sector 
to co-fund public R&I projects could be a proxy 
for how closely companies work with 
universities and public research organisations 

Reflects the emphasis on collaboration and 
sharing of experiences in R&D across borders, 
whether national, regional or organisational 

Europe-wide transnational public R&D 
programmes include R&D programmes that 
involve the flow of funds across borders for 
research purposes, as well as those that 
include transnational cooperation 

Bilateral or multilateral public R&D 
programmes comprise non-European 
Commission funded R&D research conducted 
jointly by at least two Member State 
governments, involving either the flow of funds 
or transnational cooperation 

12 

 
  
4.  Summary of ERA Scoreboard performance  

For the  ERA  Scoreboard  2023,  a  “traffic  light system” is  used  to  monitor EU performance 
towards the ERA objectives (Table 2). As performance levels are difficult to compare between 
indicators,  the  focus  is  on  performance  changes,  by  combining  information  on  relative 
performance change since 2010, since 2015, and for the last three years. 

For each period, the percentage change over that period is calculated as the change between 
the first and last year of that period divided by the average indicator value of the 2010-2021 
period.5 If percentage changes for all three periods are positive6, the indicator receives the 
highest score of “dark green”; if percentage changes for two periods are positive, the indicator 
receives  the  next  highest  score  of  “light  green”,  if  percentage  changes  for  one  period  is 
positive, the indicator receives the next highest score of “orange”; and if percentage changes 
for none of the periods are positive, the indicator receives the lowest score of “red”. 

Pact for R&I Priority areas where the EU is showing the highest level of change (“dark green”) 
include: 

•  R&D investments 
•  Gender equality 
•  Global engagement 
•  Synergies with sectorial policies and industrial policies 
•  Coordination of R&I investments 

Pact for R&I Priority areas where the EU is showing the second highest level of change (“light 
green”) include: 

•  Researchers’ careers and mobility 
•  Knowledge Valorisation 
•  Active citizen and societal engagement in R&I 

Pact for R&I Priority areas where the EU is showing the lowest level of change (“orange or 
red”) include: 

•  Scientific leadership 
•  Challenge-based ERA actions 
•  Synergies with education and the European Skills Agenda 
•  More investments and reforms in countries and regions with lower R&I performance 
•  Support to prioritise and secure long-term R&I investments and policy reforms 

Pact for R&I Priority areas for which data are not (yet) available include: 

•  Research infrastructures 
•  Synergies between Union, national and regional funding programmes 
• 

Increased  collaborative  links  and  excellence-based  integration  of  research-
performing organisations from countries and regions with lower R&I performance 

5 The same 2010-2021 period is used as the denominator for all time periods to make it easier to 
compare  percentage  changes.  There  is  no  impact  on  the  sign  (positive  or  negative)  of  these 
changes compared to using different averages for the denominator for or each time period. 

6 Table 2 shows a positive change by indicating “ >0 “, a negative change by indicating “ <0 “. 

13 

 
 
 
 
 
Table 2: ERA Scoreboard 2023 

 Indicator 

ERA Pact sub-priority 

Score  Change 

1  Gross Domestic Expenditure on R&D 
(GERD) as a percentage of GDP 
2  Researchers (in full-time equivalent) 

per million inhabitants 

3  Share of publications available in open 
access (green, gold and diamond) 

4  Share of national public R&D 
expenditure committed to joint 
programmes and initiatives, research 
infrastructures and European 
Partnerships 

R&D Investment 

R&D Investment 

Open Science 

Research infrastructures 

-- 

5  Share of women in grade A positions in 

Gender Equality 

higher education institutes 
6  Job-to-job mobility of Human 

Resources in Science & Technology 
7  Share of innovating firms collaborating 
with HEI/PRO out of all innovative firms 

Researchers’ careers and 
mobility 
Knowledge Valorisation 

8  Scientific publications among the top-

Scientific leadership 

2010-
recent 
>0 

>0 

>0 

-- 

>0 

>0 

>0 

<0 

Change 
2015-
recent 
>0 

Change 
last 3 
years 
>0 

>0 

>0 

-- 

-- 

>0 

>0 

>0 

<0 

-- 

-- 

>0 

<0 

<0 

<0 

9 

10% most cited publications worldwide 
as a percentage of all publications 
International co-publications with non-
EU partners per 1,000 researchers (in 
full-time equivalent) in the public sector 

Global engagement 

>0 

>0 

>0 

10  Environmentally related government 

Challenge-based ERA actions 

<0 

<0 

>0 

R&D budget as percentage of total 
government R&D 

11  Share of researchers receiving 
transferable skills training 

12  Direct government support and Indirect 

government support through R&D tax 
incentives as a percentage of GDP 

13  Research on social innovation 

14 

Increase in total R&D expenditure, 
expressed as a percentage of GDP 

15  Share of Seal of Excellence rewards 
that received funding from other 
sources 

16  Number of collaboration networks of 

RPOs in Widening countries with other 
EU countries 

17  Share of public R&D expenditures 
financed by the private sector 

18  Government budget allocations for 
R&D (GBARD) allocated to Europe-
wide transnational, as well as bilateral 
or multilateral, public R&D 
programmes per FTE researcher 

Synergies with education and 
the European Skills Agenda 
Synergies with sectorial 
policies and industrial policies 

Active citizen and societal 
engagement in R&I 
More investments and reforms 
in countries and regions with 
lower R&I  
performance 
Synergies between Union, 
national and regional funding 
programmes 
Increased collaborative links 
and excellence-based 
integration of research-
performing organisations from 
countries and regions with 
lower R&I performance 
Support to prioritise and 
secure long-term R&I invest-
ments and policy reforms 
Coordination of R&I invest-
ments 

-- 

-- 

<0 

>0 

>0 

<0 

-- 

-- 

<0 

>0 

>0 

<0 

-- 

-- 

-- 

>0 

<0 

<0 

-- 

-- 

<0 

<0 

<0 

>0 

>0 

>0 

14 

 
  
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5.  Performance by ERA Scoreboard indicator 

For each of the indicators the following pages will include the following 

•  A graph showing the evolution for the EU over time. 

•  A scatter plot showing the performance and change in performance of the Member 
States.  Member  States  which  perform  both  above  the  EU  average  and  where 
performance has improved more than that of the EU, are seen as having contributed 
most to the EU average over time. 

•  A graph showing the evolution of the spread in performance for individual Member 

States. 

•  A  table  showing  different  metrics  that  can  be  used  for  assessing  the  evolution  in 

performance differences between Member States, including: 

o  The variance and the standard deviation are measures of the spread of the 
data around the mean. Both metrics summarise how close each observed 
data  value  is  to  the  mean  value.  The  smaller  the  variance  and  standard 
deviation,  the  more  the  mean  value  is  indicative  of  the  whole  dataset. 
Therefore,  if  all  values  of  a dataset  are the  same,  the  standard  deviation 
and variance are zero.  

Variance is calculated as the sum of the squared deviations of the score of 
each  Member  State  with  the  mean  score  across  all  Member  States.  The 
standard deviation is calculated as the square root of the variance. 

o  Range.  The  difference  between  the  second  highest  and  second  lowest 

score across the Member States.7 

Both metrics would indicate if there has also been convergence in performance 
among  the  Member  States.  Ideally,  one  would  like  to  see  an  increase  in  EU 
performance  and  a  decrease  in  performance  differences  among  the  Member 
States, as this would indicate that the lowest performers are improving fastest 
and thereby have contributed most to the increase in EU performance. 

•  A table showing for the EU, the 27 Member States, and the eight selected Horizon 

Associated countries: 

o  Most recent score 

o  Change since 2010 

o  Change since 2015 

o  Change in last three years for which data are available 

o  Change in most recent year for which data are available 

Data  sources  for  all  indicators  are  included  in  Table  1  and  in  the  ERA  Scoreboard 
Methodology report. 

7  For  reducing  the  possible  impact  of  statistical  outliers,  the  range  is  not  calculated  as  the 
difference between the highest and lowest score across the Member States but instead as the 
difference between the second highest and second lowest score. 

15 

 
 
 
 
  General indicators 

5.1.1.  Gross Domestic Expenditure on R&D as a percentage of GDP (R&D intensity) 

The indicator measures the share of total expenditures on R&D as a percentage of GDP. For 
the EU, as shown in the first graph, there has been a continuous increase in the indicator 
from 1.97% in 2010 to 2.30% in 2020 followed by a decline to 2.26% in 2021, with recent 
developments being affected by changes in GDP (e.g. the strong increase in 2020 is fully 
explained by a decrease in GDP in the first Covid year). 

2,30%

2,26%

2,22%

2,19%

2,15%

2,08% 2,10% 2,11% 2,12% 2,12%

2,02%

1,97%

2,40%

2,30%

2,20%

2,10%

2,00%

1,90%

1,80%

2010

2011

2012

2013

2014

2015

2016

2017

2018 2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2021 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Austria, Belgium, and Germany. 

16 

 
 
 
4,00%

3,50%

3,00%

FI

DK

SE

AT

DE

BE

)
1
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

2,50%

2,00%

1,50%

1,00%

0,50%

0,00%

FR

SI

EE
PT

ES

IT

NL

CZ

HU

HR

PL

EL

LT
SK

CY

BG

LV
MT
RO

IE

LU

-1,00

-0,50

0,00

0,50

1,00

1,50

Change since 2010

The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences between Member States appear to have become smaller over time as the range 
has become smaller, but both the standard deviation and variance have increased. 

4,00%

3,50%

3,00%

2,50%

2,00%

1,50%

1,00%

0,50%

0,00%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.284  0.294  0.313  0.317  0.318  0.314  0.318  0.310  0.314  0.309  0.300  0.308 

Variance 

Range 

0.081  0.086  0.098  0.100  0.101  0.099  0.101  0.096  0.099  0.096  0.090  0.095 

2.72  2.72  2.77  2.78  2.59  2.57  2.64  2.55  2.53  2.61  2.70  2.58 

Results in Annex 1 show that for the EU and most Member States the indicator increased 
between  2010  and  2021.  For  Denmark,  Finland,  Ireland  and  Luxembourg  the  indicator 
declined. Performance improved most for Belgium, Czechia, Greece, and Poland. 

17 

 
 
 
 
 
 
 
 
Between  2015  and  2021,  the  indicator  increased  for  the  EU  and  18  Member  States  and 
declined for nine Member States. Performance improved most for Belgium, Greece, Poland, 
and Portugal. 

More recently, results over the last three years show an increase for the EU and 20 Member 
States  and  a  decline  for  seven  Member  States.  Performance  improved  most  for  Finland, 
Greece, Hungary, Portugal, and Spain. 

In 2021, the most recent year, there is a decrease for the EU and 13 Member States and an 
increase for only eight Member States, which can partly be explained by a recovery of GDP 
after its decline in most Member States in the first year of the COVID pandemic. 

For  the  Horizon  Associated  Countries  only  three  countries,  Iceland,  Serbia,  and  Türkiye, 
show an improvement since 2010 and in each of the time periods. For Armenia and Georgia 
performance has decreased since 2010. 

18 

 
 
 
 
5.1.2.  Researchers (in full-time equivalent) per million inhabitants 

The  indicator  measures  the  share  of  researchers  in  full-time  equivalents  per  million 
population. For the EU, as shown in the first graph, there has been a continuous increase 
from 3,055 in 2010 to 4,484 in 2021. 

3.055 3.126 3.250 3.345 3.385 3.528 3.628

3.837 4.002 4.151 4.219

4.483

5.000
4.500
4.000
3.500
3.000
2.500
2.000
1.500
1.000
500
0

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2021 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Austria, Belgium, Czechia, Germany, Ireland, Netherlands, Portugal, Slovenia, and 
Sweden. 

SE

10.000

9.000

8.000

7.000

6.000

5.000

4.000

3.000

2.000

1.000

)
1
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

BE

NL

HU

FI

DK

AT

DE
PT
SI

FR

IE

CZ

EL

PL

EE

LT

IT

ES
SK

BG

LV
HR
MT
CY

LU

RO

0
-1.000

0

1.000

2.000

3.000

4.000

5.000

Change since 2010

19 

 
 
 
  
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger, but 
both the standard deviation and variance have decreased. 

10.000
9.000
8.000
7.000
6.000
5.000
4.000
3.000
2.000
1.000
0
2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.246  0.237  0.243  0.241  0.241  0.238  0.240  0.235  0.232  0.233  0.234  0.235 

Variance 

Range 

0.061  0.056  0.059  0.058  0.058  0.057  0.058  0.055  0.054  0.054  0.055  0.055 

5,659  5954  6,160  6,107  5,971  5,846  6,085  6,107  6,018  6,028  5,912  6,057 

Results in Annex 2 show that for the EU and most Member States the indicator increased 
between 2010 and 2021, and only for Luxembourg has the indicator decreased. Performance 
improved most for Belgium, Hungary, Netherlands, and Sweden. 

Between 2015 and 2021, the indicator increased for the EU and 26 Member States, only for 
Ireland  the  indicator  decreased.  Performance  improved  most  for  Belgium,  Hungary,  and 
Sweden. 

More recently, results over the last three years show an increase for the EU and 24 Member 
States and a decrease for three Member States. 

In the most recent year there is an increase for the EU and 25 Member States and a decrease 
for two Member States. 

For  the  Horizon  Associated  Countries  only  two  countries,  Norway  and  Türkiye,  show  an 
improvement  since  2010  and  in  each  of  the  time  periods.  For  Iceland  performance  has 
decreased since 2010. There are no data for Armenia and Israel. 

20 

 
 
 
 
 
 
 
 
 
  Deepening a truly functioning internal market for knowledge 

5.2.1.  Share of publications available in open access 

The  indicator measures  the  share of  open-access  publications  with  digital  object  identifier 
(DOI) as percentage of total scientific publications with DOI. For the EU, as shown in the first 
graph, there has been an increase from 33.9% in 2010 to 39.2% in 2019. 

33,9%

45%

40%

35%

30%

25%

20%

39,2%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator. Data for 2009 (used for 2010) and 2019 are available from the 2022 
Science, Research and Innovation Performance of the EU (SRIP) report. New data, including longer time series data, 
are expected to become available in the 2024 SRIP report. 

Member States that contribute most to the EU average in 2019 include all countries above the 
horizontal blue line in the graph below. Member States for which performance has changed more 
than that of the EU, include all countries to the right of the vertical blue line. Member States in the 
top-right quadrant have contributed most to the EU average over time, Austria, Denmark, Finland, 
Germany, Hungary, Luxembourg, Netherlands, Poland, Slovenia, Spain, and Sweden. 

)
9
1
0
2
(
e
r
o
c
s

t
s
e
t
a
L

65%

60%

55%

50%

45%

40%

35%

30%

25%

20%

NL

SE

AT
FI

HU

DK

LT
IE
BE

FR
IT

ES

SI

PL

DE
CY

LU

HR

MT

EE

PT

CZ

EL

SK

LV

BG

RO

-10

-5

0

5

10

15

20

25

Change since 2010

21 

 
 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger, and 
both the standard deviation and variance have increased. 

60%

55%

50%

45%

40%

35%

30%

25%

20%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

Variance 

Range 

0.192 

0.037 

15.3 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

--  0.249 

--  0.062 

--  28.6 

-- 

-- 

-- 

-- 

-- 

-- 

Results  in  Annex  3  show  that  for  the  EU  and  22  Member  States  the  indicator  increased 
between 2010 and 2019, only for Bulgaria, Croatia, Latvia, Malta and Slovakia the indicator 
declined.  Performance  improved  most  for  Austria,  Finland,  Hungary,  Luxembourg, 
Netherlands, and Sweden. 

For the  Horizon  Associated Countries  the  indicator increased  between  2010  and  2019  for 
Iceland and Norway, and decreased for Israel, Montenegro, Serbia, and Türkiye. There are 
no data for Armenia and Georgia. 

22 

 
 
 
 
 
 
 
 
5.2.2.  Share of women in grade A positions in higher education 

The indicator measures the share of women in grade A positions in higher education. Grade 
A is the highest level at which research is typically conducted and in most countries grade A 
is equivalent to a full professorship. For the EU, as shown in the first graph, there has been 
a strong increase from 22.3% in 2010 to 27.2% in 2018. 

25,1% 25,5% 25,9%

26,7% 27,2%

22,9% 23,4%

22,3%

24,1%

30%

28%

26%

24%

22%

20%

18%

16%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator. Data are taken from the 2021 edition of the She Figures report, 
which uses 2018 as the most recent data. 

Member States that contribute most to the EU average in 2018 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Croatia, Finland, France, Latvia, Romania, Slovenia, and Sweden. 

45%

40%

35%

30%

25%

20%

15%

)
8
1
0
2
(
e
r
o
c
s

t
s
e
t
a
L

10%

-5

LT

LV

RO

BG

HR

SI

FI

SE

SK
PT

AT

FR

IE

ES

DK

DE

BE

NL

PL

IT

EL

HU

LU

CY

0

5

10

15

20

Change since 2010

Note: Malta is not shown as its performance change of -25.3 is off the horizontal scale. 

23 

 
 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become smaller over time as the range has become smaller, but 
both the standard deviation and variance have increased. 

50%
45%
40%
35%
30%
25%
20%
15%
10%
5%
0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.222  0.230  0.226  0.231  0.258  0.273  0.267  0.252  0.269 

Variance 

Range 

0.049  0.053  0.051  0.053  0.066  0.074  0.071  0.063  0.072 

26.2  26.0  24.7  23.7  22.4  21.7  22.5  23.7  22.9 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

Results  in  Annex  4  show  that  for  the  EU  and  23  Member  States  the  indicator  increased 
between  2010  and  2018,  and  only  decreased  for  Malta.  Performance  increased  most  for 
Bulgaria, Romania, and Slovenia,  

Between  2015  and  2018,  performance  improved  for  the  EU  and  23  Member  States, 
performance  only  decreased  for  Malta.  Performance  increased  most  for  Bulgaria,  Ireland, 
Netherlands, and Slovenia, 

In the most recent year there is an increase for the EU and 16 Member States and a decrease 
for two Member States, Lithuania and Malta. 

For  the  Horizon  Associated  Countries  only  two  countries,  Israel  and  Norway,  show  an 
improvement  since  2010  and  in  each  of  the  time  periods.  There are no  data  for Armenia, 
Georgia, Montenegro, and Serbia. 

24 

 
 
 
 
 
 
 
 
5.2.3.  Job-to-job mobility of Human Resources in Science & Technology 

The  indicator measures  job-to-job  mobility  of  Human  Resources  in  Science &  Technology 
(HRST). HRST are people who fulfil at least one of the following conditions: have successfully 
completed a tertiary level education; not formally qualified as above but employed in a S&T 
occupation  where  the  above  qualifications  are  normally  required.  Job-to-job  mobility  is 
defined as the movement of individuals between one job and another from one year to the 
next. For the EU, there has been an increase from 5.5% in 2010 to 7.6% in 2019, followed 
by a decrease to 6.8% in 2020 due to employees working more from home  and switching 
less between employers during the first year of the Covid-19 pandemic. 

7,6%

7,3%

6,9%

6,8%

5,5% 5,6% 5,6%

5,4% 5,4%

6,2%

5,9%

8,0%

7,5%

7,0%

6,5%

6,0%

5,5%

5,0%

4,5%

4,0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 
Member States that contribute most to the EU average in 2020 include all countries above the 
horizontal blue line in the graph below. Member States for which performance has changed more 
than that of the EU include all countries to the right of the vertical blue line. Member States in the 
top-right quadrant have contributed most to the EU average over time, including Croatia, Cyprus, 
Denmark, Estonia, France, Germany, Lithuania, Luxembourg, and Spain. 

)
0
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

12%

10%

8%

6%

4%

2%

0%

DK

LT
CY

LU

EE

NL

FI

DE

MT

AT

SI
PT
PL

FR

ES

HR

HU

BE

LV

EL

CZ

SE

IT

SK

BG

RO

-2,0

-1,0

0,0

1,0

2,0

3,0

4,0

5,0

Change since 2010

25 

 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger,  and 
both the standard deviation and variance have increased. 

14%

12%

10%

8%

6%

4%

2%

0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.214  0.214  0.214  0.214  0.214  0.211  0.234  0.216  0.270  0.269  0.255 

Variance 

Range 

0.046  0.046  0.046  0.046  0.046  0.045  0.055  0.047  0.073  0.072  0.065 

5.1 

5.6 

5.2 

5.2 

6.3 

5.5 

8.0 

6.4 

8.3 

7.8 

7.9 

-- 

-- 

-- 

Results  in  Annex  5  show  that  for  the  EU  and  23  Member  States  the  indicator  increased 
between 2010 and 2020, performance only decreased for Czechia, Romania, and Sweden. 
Performance increased most for Croatia, Cyprus, Estonia, Hungary, and Lithuania. 

Between  2015  and  2020,  the  indicator  increased  for  the  EU  and  22  Member  States, 
performance  only  decreased  for  Romania  and  Sweden.  Performance  improved  most  for 
Cyprus, Estonia, and Lithuania. 

More recently, results over the last three years show a decrease for the EU and 15 Member 
States and an increase for 11 Member States. 

In the most recent year there is a decrease for the EU and 16 Member States and an increase 
for seven Member States. 

For five Horizon Associated Countries performance increased between 2010 and 2020 and 
for performance decreased in the most recent year. There are no data for Armenia, Georgia, 
and Israel. 

26 

 
 
  
 
 
 
 
 
 
 
5.2.4.  Share of innovating firms collaborating with HEI/PRO out of all innovative firms 

The  indicator  measures  the  share  of  firms  that  innovate  and  that  collaborate  with  higher 
education  institutes  and  public  research  organisations.  For  the  EU,  as  shown  in  the  first 
graph, there has been a strong increase from 8.5% in 2010 to 15.1% in 2018, followed by a 
decrease to 13.3% in 2020. 

10,9%

11,2%

12,6%

11,7%

15,1%

13,3%

16%
15%
14%
13%
12%
11%
10%
9%
8%
7%
6%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2020 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Austria, Estonia, and Ireland. 

30%

25%

)
0
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

20%

15%

10%

FI

AT

IE

SI

BE

EL

HU

HR

DE

SE
DK

FR
LTLU
NL

CZ

PL

ES
PT

EE

LV

IT

MT

RO

SK

5%

CY

BG

0%

-15,0

-10,0

-5,0

0,0

5,0

10,0

15,0

Change since 2010

27 

 
 
 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger,  and 
both the standard deviation and variance have increased. 

50%
45%
40%
35%
30%
25%
20%
15%
10%
5%
0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

Variance 

Range 

0.218 

0.048 

14.0 

--  0.242 

--  0.257 

--  0.240 

--  0.230 

--  0.266 

--  0.059 

--  0.066 

--  0.058 

--  0.053 

--  0.071 

--  15.1 

--  15.4 

--  18.6 

--  30.6 

--  18.2 

-- 

-- 

-- 

Results  in  Annex  6  show  that  for  the  EU  and  18  Member  States  the  indicator  increased 
between 2010 and 2020. Performance improved most for Estonia, Ireland, Italy, and Malta. 

Between  2015  and  2020,  the  indicator  increased  for  the  EU  and  14  Member  States  and 
decreased for 13 Member States. 

More recently, results over the last three years show a decrease for the EU and 20 Member 
States and an increase for seven Member States. 

For  the  Horizon  Associated  Countries  the  indicator  has  increased  since  2010  for  Iceland, 
Serbia,  and  Türkiye,  and  decreased  for Norway.  There  are no  data  for Armenia,  Georgia, 
Israel, and Montenegro. 

28 

 
 
 
 
 
 
 
5.2.5.  Number of scientific publications among the top-10% most cited publications 

worldwide as a percentage of all publications 

The indicator is a proxy for the scientific impact and relevance of the scientific publications. 
For the EU, as shown in the first graph, there has been a decrease from 10.1% in 2010 to 
9.8% in 2020. 

10,1% 10,1%

10,2% 10,2%

10,2% 10,1% 10,1%

9,9%

9,8% 9,8% 9,8%

10,4%

10,2%

10,0%

9,8%

9,6%

9,4%

9,2%

9,0%

2010

2011

2012

2013

2014

2015

2016

2017

2018 2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2020 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Cyprus, Finland, and Italy. 

16%

14%

NL

12%

DK

)
0
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

10%

8%

6%

4%

2%

0%

LU

IE

BE
SE

DE

AT

FI

FR

PT

ES

EL

EE

IT

CY

MT

SI

HU

CZ

HR

SK

RO

LT

PL

LV

BG

-3,0

-2,0

-1,0

0,0

1,0

2,0

3,0

4,0

Change since 2010

29 

 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become smaller over time as the range has become smaller, and 
both the standard deviation and variance have decreased. 

18%
16%
14%
12%
10%
8%
6%
4%
2%
0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.287  0.300  0.299  0.313  0.312  0.301  0.308  0.294  0.277  0.289  0.267 

Variance 

Range 

0.082  0.090  0.089  0.098  0.097  0.091  0.095  0.086  0.077  0.084  0.071 

11.93  12.18  12.67  11.51  11.52  10.94  11.46  9.86  9.73  10.61  8.33 

-- 

-- 

-- 

Results  in  Annex  7  show  that  for  the  EU  and  12  Member  States  the  indicator  decreased 
between 2010 and 2020 and increased for 15 Member States. Performance improved most 
for Latvia, Lithuania, Malta, Poland, and Romania. 

Between  2015  and  2020,  the  indicator  decreased  for  the  EU  and  12  Member  States  and 
increased for 15 Member States. 

More recently, change results over the last three years show a decrease for the EU (although 
marginal) and 11 Member States (including AT, BE, BG, DE, DK, EE, FI, IE, NL, PT, SE) and 
an increase for 16 Member States. 

In the most recent year there is a marginal decrease for the EU), a decrease for 13 Member 
States and an increase for 14 Member States. 

For  the  Horizon  Associated  Countries  the  indicator  has  increased  for  all  time  periods  for 
Serbia and Türkiye. The indicator decreased for all time periods for Israel and Norway. 

30 

 
 
 
 
 
 
 
5.2.6. 

International co-publications with non-EU partners per million population 

The indicator measures the number of scientific co-publications per 1,000 researchers with 
at  least  one  co-author  from  a  non-EU  country  at  the  EU  level.  From  the  perspective  of 
individual countries, the indicator is more broadly defined by including co-publications with at 
least one co-author in any foreign country (including another EU country). Data limited to only 
non-EU countries are not available and such a limitation is in any case considered to be less 
relevant  as  for  individual  countries  all  publications  with  a  foreign  co-author  contribute  to 
international collaborations. For the EU, as shown in the first graph, there has been a strong 
increase from 217.4 in 2010 to 358.7 in 2021. 

232,9 244,9 259,4 273,6 284,5 297,4 302,5 312,3 320,7

217,4

358,7

340,0

400

350

300

250

200

150

100

50

0

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average - including all publications with foreign 
partners (i.e. the second definition) - in 2021 include all countries above the horizontal blue line 
in the graph below. Member States for which performance has changed more than that of the 
EU  include  all  countries  to  the  right  of  the  vertical  blue  line.  Member  States  in  the  top-right 
quadrant have contributed most to the EU average over time, including 14 Member States. 

31 

 
 
 
4.000

3.500

3.000

2.500

2.000

1.500

)
2
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

1.000

FR

DK

LU

CY

SE

FI

EE

NL

BE

AT

IE

SI

PT

MT

DE

ELES
IT

CZ

HR

LT

LV

SK

HU
PL

500

BG

RO

0

0

500

1.000

1.500

2.000

2.500

3.000

Change since 2010

Note: blue lines for EU shows results for co-publications with all foreign partners. 

The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger, but 
both the standard deviation and variance have decreased. 

4.000

3.500

3.000

2.500

2.000

1.500

1.000

500

0
2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022

Note: red line for EU shows results for co-publications with all foreign partners. 

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021  2022 

Standard deviation  0.311  0.303  0.303  0.308  0.293  0.289  0.282  0.278  0.276  0.281  0.277  0.285  0.298 

Variance 

Range 

0.096  0.092  0.092  0.095  0.086  0.083  0.080  0.078  0.076  0.079  0.077  0.081  0.089 

1,449  1,505  1,648  1,848  2,128  2,162  2,136  2,193  2,319  2,486  2,539  2,989  3,294 

32 

 
  
 
 
 
 
 
 
 
Results  in  Annex  8  show  that  for  the  EU  and  all  Member  States  the  indicator  increased 
between both assessed periods, i.e. between 2010 and 2021 (2022 for the Member States) 
and between 2015 and 2021 (2022 for the Member States). In both time periods performance 
has increased most for Cyprus, Denmark, and Luxembourg. 

More  recently,  results  over  only  the  last  three  years  show  an  increase  for  the  EU and  25 
Member States. Performance decreased only for France and Slovakia. 

In only the most recent year there is an increase for the EU (in 2021) and 13 Member States 
(in  2022)  and  a  decrease  for  14  Member  States  (in  2022).  However,  using  the  second 
definition  also  for  the  EU  –  including  co-publications  with  all  foreign  partners  –  shows  a 
decrease for the EU in 2022. 

For the Horizon Associated Countries the indicator has increased for all countries between 
2010 and 2022. More recently the indicator only decreased for Montenegro. 

33 

 
 
  Taking up together the green transition and digital transformation and 
other  challenges  with  impact  on  society,  and  increasing  society’s 
participation in the ERA 

5.3.1.  Environmentally related government R&D budget as % of total government R&D 

The  indicator  measures  the  share  of  the  R&D  budget  of  the  government  dedicated  to 
environmentally  related  research.  For  the  EU,  as  shown  in  the  first  graph,  this  share  has 
declined from an average of about 2.8% for 2010-2015 to 2.5% for 2016-2020. 

3,0%

2,6%

2,6% 2,7% 2,6%

3,0%

2,4% 2,5% 2,5% 2,4% 2,5%

3,5%

3,0%

2,5%

2,0%

1,5%

1,0%

0,5%

0,0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 
Member States that contribute most to the EU average in 2020 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Austria, Finland, Greece, Hungary, Italy, Latvia, Portugal, and Slovenia. 

)
0
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

7,0%

6,0%

5,0%

4,0%

3,0%

2,0%

1,0%

0,0%

LV

RO

SI

PT

HU

EL

ES

SK
DE

IT

FI
AT

EE
PL

LU

CZ
FR

SE

IE

DK

NL

BE

LT

-6,0

-5,0

-4,0

-3,0

-2,0

-1,0

0,0

1,0

2,0

3,0

Change since 2010

34 

 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become smaller over time as the range has become smaller, and 
both the standard deviation and variance have decreased. 

10%
9%
8%
7%
6%
5%
4%
3%
2%
1%
0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.299  0.291  0.219  0.275  0.259  0.291  0.219  0.275  0.259  0.320  0.278 

Variance 

Range 

0.090  0.085  0.048  0.076  0.067  0.085  0.048  0.076  0.067  0.102  0.077 

5.10  6.94  4.77  6.32  6.73  6.94  4.77  6.32  6.73  5.26  4.65 

-- 

-- 

-- 

Results in Annex 9 show that for the EU and  nine Member States the indicator decreased 
between 2010 and 2020. The indicator increased for 12 Member States and most strongly 
for Austria, Finland, Greece, and Slovenia. 

Between  2015  and  2020,  the  indicator decreased  for the  EU and  12  Member States,  and 
performance increased for nine Member States. 

More  recently,  results  over  the  last  three  years  show  a  marginal  increase  for  the  EU,  an 
increase for 16 Member States, and a decrease for five Member States. 

In the most recent year there is an increase for the EU and 13 Member States and a decrease 
for eight Member States. 

For the Horizon Associated Countries the indicator has increased for Norway and decreased 
for Türkiye. There are no data for Armenia, Georgia, Iceland, Israel, Montenegro, and Serbia. 

35 

 
 
 
 
 
 
 
 
5.3.2.  Share of researchers receiving transferable skills training 

The indicator measures the share of R1 – Doctoral or equivalent – researchers enrolled in a 
PhD programme or R2 – Post-Doctoral or equivalent – researchers with a PhD that indicate 
they  received  training  in  transferable  skills  or  developed  transferable  skills  through  work 
experience. For the EU, as shown in the first graph, there has been a strong increase from 
49.5% in 2016 to 46.3% in 2019. 

49,5%

46,3%

52%
50%
48%
46%
44%
42%
40%
38%
36%
34%
32%
30%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2019 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Denmark, Estonia, France, Hungary, Italy, Lithuania, and Romania. 

100%

90%

80%

70%

60%

50%

)
9
1
0
2
(
e
r
o
c
s

t
s
e
t
a
L

40%

SI

LU

BG

30%

20%

RO

AT

HU

DK

IT

IE ES
LV

SE

CZ

SKFI

BE

NL

HR

EE

FR

LT

PT

PL

DE

-40

-30

-20

-10

0

10

20

30

40

50

Change since 2010

36 

 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger,  and 
both the standard deviation and variance have increased. 

100%

90%

80%

70%

60%

50%

40%

30%

20%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

Variance 

Range 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

--  0.214 

--  0.046 

--  32.5 

-- 

-- 

-- 

--  0.251 

--  0.063 

--  40.1 

-- 

-- 

-- 

-- 
-- 
-- 

Results in Annex 10 show that for the EU and 15 Member States the indicator decreased 
between 2016 and 2019 and increased for nine Member States. Performance improved most 
for Austria, Hungary, Italy, and Romania. 

For  the  two  Horizon  Associated  Countries  for  which  data  are  available,  the  indicator 
decreased for Norway between 2016 and 2019 and stayed the same for Iceland. 

37 

 
 
 
 
 
 
 
 
5.3.3.  Direct government support and Indirect government support through R&D tax 

incentives as a percentage of GDP 

The indicator measures total government support to business R&D. Public financing of R&D 
can take two forms: direct funding for R&D through instruments such as grants and public 
procurement, and indirect support through the tax system. This indicator measures the sum 
of both as a percentage share of GDP. For the EU, as shown in the first graph, there has 
been an increase from 0.150% in 2010 to 0.182% in 2020. 

0,155%

0,152%

0,156%

0,161%

0,158%

0,150%

0,146%

0,175%0,177%

0,182%

0,166%

0,190%

0,180%

0,170%

0,160%

0,150%

0,140%

0,130%

0,120%

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2019 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Austria, Belgium, Netherlands, and Portugal. 

)
0
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

0,450%

0,400%

0,350%

0,300%

0,250%

0,200%

0,150%

0,100%

0,050%

0,000%

FR

IE

SE

AT

BE

PT

NL

IT

PL

HU

SI

HR

CZ

ES

DE

FI

EE

DK

SK

EL

-0,20

-0,15

-0,10

-0,05

RO

MT

LU

LT
CY

LV
BG

0,00

0,05

0,10

0,15

0,20

Change since 2010

38 

 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger, and 
both the standard deviation and variance have increased. 

0,450%
0,400%
0,350%
0,300%
0,250%
0,200%
0,150%
0,100%
0,050%
0,000%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.262  0.285  0.288  0.305  0.306  0.278  0.259  0.253  0.272  0.285  0.276 

Variance 

Range 

0.069  0.081  0.083  0.093  0.094  0.077  0.067  0.064  0.074  0.081  0.076 

0.261  0.314  0.353  0.334  0.341  0.334  0.286  0.237  0.273  0.333  0.350 

-- 

-- 

-- 

Results  in  Annex  11  show  that  for  the  EU  and  16  Member  States  the  indicator  increased 
between 2010 and 2020. The indicator improves most for Austria, Belgium, Italy, Poland, and 
Portugal. 

Between 2015 and 2020, the indicator increased for the EU and 18 Member States. 

More recently, results over the last three years show an increase for the EU and 21 Member 
States. 

In  the  most  recent  year  there  is  an  increase  for  the  EU  and  18  Member  States,  and  a 
decrease for nine Member States. 

For five Horizon Associated Countries the indicator has increased between 2010 and 2020, 
it only decreased for Israel. There are no data for Armenia and Georgia. 

39 

 
 
 
 
 
 
5.3.4.  Scientific publications on social innovation per million population 

The  indicator  measures  the  share  of  publications  related  to  social  innovation  per  million 
population. For the EU, as shown in the first graph, there has been a strong increase from 
0.32 in 2010 to 1.87 in 2017, followed by decline to 1.75 in 2021. 

1,87

1,71

1,54

1,74

1,76

1,75

2,00
1,80
1,60
1,40
1,20
1,00
0,80
0,60
0,40
0,20
0,00

1,25

0,88

0,94

0,66

0,32

0,36

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2021 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including  Austria,  Croatia,  Cyprus,  Denmark,  Finland,  Italy,  Latvia,  Lithuania,  Malta, 
Netherlands, Portugal, Slovenia, Spain, and Sweden. 

9,00

8,00

7,00

6,00

5,00

4,00

3,00

2,00

)
1
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

1,00

CZ

FR

0,00

RO

0,00

HU
DEEE

IE
PL
SK

HR

NL

PT

FI

CY

LV

DK

AT

ES

SI

LT

SE

BE

IT

MT

LU

BG

EL

1,00

2,00

3,00

4,00

5,00

6,00

7,00

8,00

Change since 2010

40 

 
 
 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become larger over time as the range has become larger,  and 
both the standard deviation and variance have increased. 

12,0

10,0

8,0

6,0

4,0

2,0

0,0

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.246  0.252  0.241  0.299  0.268  0.257  0.320  0.320  0.274  0.239  0.290  0.277 

Variance 

Range 

0.061  0.064  0.058  0.090  0.072  0.066  0.103  0.102  0.075  0.057  0.084  0.077 

0.95  2.41  3.05  3.89  3.74  5.86  7.87  6.80  6.02  6.46  8.56  5.99 

Results  in  Annex  12  show  that  for  the  EU  and  25  Member  States  the  indicator  increased 
between 2010 and 2021, it only decreased for Estonia and Malta. The indicator increased 
most for Croatia, Cyprus, Latvia, Netherlands, and Portugal. 

Between 2015 and 2021, the indicator increased for the EU and 18 Member States. 

More  recently,  results  over  the  last  three  years  show  an  increase  for  the  EU  (although 
marginal) and 12 Member States, and a decrease for 15 Member States. 

In the most recent year there is a decrease for the EU (although marginal) and 19 Member 
States, and an increase for eight Member States. 

For the Horizon Associated Countries the indicator has increased for six countries between 
2010 and 2021, including Armenia, Iceland, Israel, Norway, Serbia, and Türkiye. It decreased 
in the most recent year only for Iceland. 

41 

 
 
 
 
 
 
 
 
 
  Enhancing access to research and innovation excellence across the 
innovation 

inter-connections  between 

Union  and  enhancing 
ecosystems across the Union 

5.4.1. 

Increase in total R&D expenditure, expressed as a percentage of GDP 

The indicator measures the increase in total R&D expenditure for widening countries as a 
percentage of GDP, with the percentage change calculated as the differences between the 
average R&D intensities in two consecutive years. For the widening countries, as shown in 
the first graph, the indicator shows positive annual changes for all years except 2016. 

0,12
0,09
0,06
0,03
0,00
-0,03
-0,06
-0,09
-0,12

0,07

0,07

0,05

0,06

0,05

0,01

0,02

0,02

0,10

0,10

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

-0,08

See Table 1 for the data source for this indicator. Widening countries include Bulgaria, Croatia, Cyprus, Czechia, 
Estonia, Greece, Hungary, Latvia, Lithuania, Malta, Poland, Portugal, Romania, Slovakia, and Slovenia. 
Widening countries that contribute most to the average in 2021 include all countries above 
the horizontal blue line in the graph below. Widening countries for which performance has 
changed more than that of the average include all countries to the right of the vertical blue 
line. Widening countries in the top-right quadrant have contributed most to the average over 
time, including Cyprus, Hungary, Poland, Portugal, and Slovakia. 

0,08

0,06

0,04

0,02

0,00

-0,02

-0,04

-0,06

)
1
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

PT

PL

SK
HU

CY

HR

EE

CZ

RO

SI

LV

MT

LT

EL

BG

-0,08

-0,80

-0,60

-0,40

-0,20

0,00

0,20

Change since 2010

42 

 
 
 
 
 
The evolution of the spread in performance for individual widening countries is shown in the 
graph below, with the average for the group of widening countries shown as a red line and 
each individual country with a blue dot. Differences appear to have become smaller over time 
as  the  range  has  become  smaller,  and  both  the  standard  deviation  and  variance  have 
decreased marginally. 

0,8

0,6

0,4

0,2

0

-0,2

-0,4

-0,6

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

--  0.195  0.194  0.177  0.185  0.181  0.274  0.202  0.265  0.236  0.314  0.193 

Variance 

Range 

--  0.038  0.038  0.031  0.034  0.033  0.075  0.041  0.070  0.056  0.098  0.037 

--  0.39  0.23  0.21  0.27  0.23  0.29  0.17  0.18  0.15  0.20  0.09 

Annex 13 show results for all Member States and Horizon Associated countries. 

For the group of widening countries as a collective and 11 of these individual countries, the 
indicator decreased between 2011 and 2021, indicating that the annual increase is slowing 
down,  not  that  the  share  of  R&D  expenditures  in  GDP  as  such  is  falling.  Performance 
increased only for Croatia, Cyprus, Poland, and Portugal. 

Between 2015 and 2021, the indicator decreased for the group  of widening countries and 
nine  of  these  countries.  Performance  increased  for  Cyprus,  Czechia,  Hungary,  Latvia, 
Portugal, and Slovenia. 

More recently, results over the last three years show a decrease for the group of widening 
countries and nine of these countries. 

In the most recent year there is a decrease for the EU  as a whole and 14 of the widening 
countries. The annual change in the R&D intensity only increased for Romania. 

For the Horizon Associated Countries the indicator has increased between 2011 and 2021 
for Serbia and Türkiye and decreased for Armenia, Georgia, Israel, and Norway. 

43 

 
 
 
 
 
 
  Advancing  concerted  research  and  innovation  investments  and 

reforms  

5.5.1.  Share of public R&D expenditures financed by the private sector 

The  indicator  measures  the  share  of  R&D  expenditures  by  the  higher  education  and 
government sector that are financed by the business sector. For the EU, as shown in the first 
graph, there has been a decrease from 8.54% in 2010 to 7.87% in 2020. 

8,54%

8,35% 8,45%

8,27% 8,31%

8,46% 8,46%

7,90%

7,99%

7,87%

7,72%

9,0%

8,5%

8,0%

7,5%

7,0%

6,5%

6,0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 
Member States that contribute most to the EU average in 2021 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Belgium, Bulgaria, Germany, and Romania. 

)
0
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

14%

12%

10%

8%

6%

4%

2%

0%

LT

LV

SI

NL

EL
HR

FI

HU

SK

RO

DE

BE

BG

ES

AT

FR

EE

IT

PL

SE

CZ
DK

IE

PT

LU
CY

MT

-12,0

-10,0

-8,0

-6,0

-4,0

-2,0

0,0

2,0

4,0

6,0

Change since 2010

44 

 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have become smaller over time as the range has become smaller, and 
both the standard deviation and variance have decreased. 

18%
16%
14%
12%
10%
8%
6%
4%
2%
0%

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

0.314  0.248  0.296  0.264  0.278  0.302  0.254  0.270  0.266  0.290  0.284 

Variance 

Range 

0.099  0.062  0.087  0.070  0.077  0.091  0.065  0.073  0.071  0.084  0.081 

12.04  10.19  12.32  11.78  12.39  11.41  11.62  10.72  9.34  9.18  9.66 

-- 

-- 

-- 

Results in Annex 14 show that for the EU and 16 Member States the indicator decreased 
between 2010 and 2020, and  performance increased for 11 Member States. Performance 
increased most for Bulgaria, Estonia, and Italy. 

Between  2015  and  2020,  the  indicator decreased  for the  EU and  14  Member States,  and 
performance increased for 13 Member States. 

More recently, results over the last three years show a decrease for the EU and 15 Member 
States. 

In the most recent year there is an increase for the EU and nine Member States. 

For the Horizon Associated Countries the indicator has increased between 2010 and 2020 
or Montenegro and decreased for Iceland, Norway, Serbia and Türkiye. There are no data 
for Armenia, Georgia, and Israel. 

45 

 
 
 
 
 
 
 
5.5.2.  Government budget allocations for R&D allocated to Europe-wide transnational, 
as well as bilateral or multilateral, public R&D programmes per FTE researcher 

The  indicator  measures  the  share  of  government  budget  allocations  for  R&D  allocated  to 
Europe-wide transnational, as well as bilateral or multilateral, public R&D programmes per 
million researchers. For the EU, as shown in the first graph, performance fluctuates over time, 
starting from a high value of 1,936 in 2011 but falling to 1,789 in 2021 despite two peaks in 
2016 and 2020. 

1.936

1.898

1.973

1.948

1.796

1.809

1.785 1.770

1.789

1.789

1.699

2.000
1.950
1.900
1.850
1.800
1.750
1.700
1.650
1.600
1.550

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

See Table 1 for the data source for this indicator 

Member States that contribute most to the EU average in 2021 include all countries above 
the  horizontal  blue  line  in  the  graph  below.  Member  States  for  which  performance  has 
changed more than that of the EU include all countries to the right of the vertical blue line. 
Member States in the top-right quadrant have contributed most to the EU average over time, 
including Cyprus, Germany, Italy, Luxembourg, and Spain. 

4.500

4.000

3.500

3.000

2.500

2.000

1.500

1.000

500

)
1
2
0
2
(
e
r
o
c
s

t
s
e
t
a
L

0
-2.000

BE

IT

LU

DE

ES

AT

CY

EE

IE
SI

HR

LV

LT

CZ

DK
RO

PL
PT

SK
MT

HU
BG

NL

SE

FI

EL

-1.000

0

1.000

2.000

3.000

Change since 2010

46 

 
 
 
 
 
 
 
The  evolution  of  the  spread  in  performance  for  individual  Member  States  is  shown  in  the 
graph  below,  with  the  EU  shown  as  a  red  line  and  each  Member  State  with  a  blue  dot. 
Differences appear to have stayed the same over time as the range has hardly changed, but 
both the standard deviation and variance have increased. 

6.000

5.000

4.000

3.000

2.000

1.000

0
2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

2021

2010  2011  2012  2013  2014  2015  2016  2017  2018  2019  2020  2021 

Standard deviation 

--  0.267  0.255  0.261  0.247  0.262  0.254  0.290  0.296  0.312  0.289  0.304 

Variance 

Range 

--  0.071  0.065  0.068  0.061  0.069  0.064  0.084  0.087  0.097  0.083  0.093 

--  3690  3531  3797  4320  3856  4318  4199  3504  3632  4434  3631 

Results in Annex 15 show that for the EU and 12 Member States the indicator decreased 
between  2011  and  2021,  and  it  increased  for  14  Member  States.  Performance  increased 
most for Estonia and Luxembourg. 

Between  2015  and  2020,  the  indicator  decreased  for  the  EU  and  13  Member  States  and 
increased for 13 Member States. 

More  recently,  results  over  the  last  three  years  show  a  marginal  decrease  for  the  EU,  a 
decrease for 12 Member States, and an increase for 14 Member States. 

In the most recent year there is a decrease for the EU and 14 Member States. 

For the Horizon Associated Countries performance increased for Serbia and decreased for 
Norway. There are no data for Armenia, Georgia, Iceland, Israel, Montenegro, and Türkiye. 

47 

 
 
 
 
 
 
 
6.  Results for Horizon Europe Associated Countries 

The  most  recent  results  for all indicators  for each  of  the  eight  Horizon  Europe  Associated 
Countries  are  shown  in  Table  3.  Data  availability  is  good  for  Norway,  with  data  for  15 
indicators,  Iceland  and  Türkiye,  with  data  for  13  indicators,  and  Serbia,  with  data  for  12 
indicators. Data availability is relatively good for Montenegro, with data for 10 indicators, and 
Israel, with data for eight indicators. Data availability is relatively poor for Georgia, with data 
for six indicators, and Armenia, with data for five indicators. 

Table 3: ERA Scoreboard 2023: data for Horizon Europe Associated Countries 

#1 

#2 

#3 

#4 

#5 

#6 

#7 

#8 

#9 

#10 

#11 

#12 

Gross Domestic Expenditure on R&D 
(GERD) as a percentage of GDP 
Researchers (in full-time equivalent) per 
million inhabitants 
Open access scientific publications with 
digital object identifier (DOI) as % of total 
scientific publications with (DOI) 
Share of national public R&D expenditure 
committed to joint programmes and 
initiatives, research infrastructures and 
European Partnerships 
Share of women in grade A positions in 
higher education institutes 
Job-to-job mobility of Human Resources in 
Science & Technology 
Share of innovating firms collaborating with 
HEI/PRO out of all innovative firms 
Number of scientific publications among the 
top-10% most cited publications worldwide 
as a percentage of all publications 
International co-publications with non-EU 
partners per 1,000 researchers (in full-time 
equivalent) in the public sector 
Environmentally related government R&D 
budget as percentage of total government 
R&D 
Share of researchers receiving transferable 
skills training 
Direct government support and Indirect 
government support through R&D tax 
incentives as a percentage of GDP 

AM  GE 

IS 

IL  ME  NO 

RS 

TR 

0.21  0.25  2.81  5.56  0.50  1.94  0.99  1.13 

N/A  1,624  6,944  N/A  4,763  7,162 

789  2,207 

N/A  N/A  51.4  36.7  40.8  53.7  42.1  29.8 

N/A  N/A  N/A  N/A  N/A  N/A  N/A  N/A 

N/A  N/A  26.3  19.5  N/A  30.9  N/A  30.5 

N/A  N/A 

8.9  N/A 

3.4 

9.2 

5.7 

7.1 

N/A  N/A  14.1  N/A  N/A  14.3  16.9  15.9 

2.1 

3.7  10.7 

8.6 

4.2  10.9 

5.3 

7.4 

256.1  269.8  4348  1271  736.6  3358  697.2  203.1 

N/A  N/A  N/A  N/A  N/A  3.05  N/A  0.80 

N/A  N/A  70.5  N/A  N/A  50.9  N/A  N/A 

N/A  N/A  0.106  0.104  0.001  0.235  0.023  0.202 

#13  Research on social innovation 

0.34  0.00  2.71  0.11  0.00  8.16  0.29  0.30 

#14 

#15 

#16 

#17 

#18 

Increase in total R&D expenditure, 
expressed as a percentage of GDP 
Share of Seal of Excellence rewards that 
received funding from other sources 
Number of collaboration networks of RPOs in 
Widening countries with other EU countries 
Share of public R&D expenditures financed 
by the private sector 
Government budget allocations for R&D 
(GBARD) allocated to Europe-wide 
transnational, as well as bilateral or 
multilateral, public R&D programmes per 
FTE researcher 

0.00  -0.05  0.32  -0.15  0.00  -0.31  0.08  0.00 

N/A  N/A  N/A  N/A  N/A  N/A  N/A  N/A 

N/A  N/A  N/A  N/A  N/A  N/A  N/A  N/A 

N/A  N/A  4.79  N/A  14.85  3.79  0.12  1.09 

N/A  N/A  N/A  N/A  N/A  2,075  1,375  N/A 

48 

 
 
 
 
 
 
  Armenia 

For Armenia, most indicators do not have data available. For those indicators for which data 
are available, Armenia is performing below the level of the EU. Gross Domestic Expenditure 
on R&D is very low at only 0.21% of GDP. Scientific articles are of lower quality as  only a 
small share is among the top-10% most cited papers. The number of international scientific 
co-publications is also relatively low. 

  Georgia 

For Georgia, most indicators do not have data available. For those indicators for which data 
are available, Georgia is performing below the level of the EU. Gross Domestic Expenditure 
on  R&D  is  very  low  at  only  0.25%  of  GDP  and  has  decreased  in  2021.  The  share  of 
researchers per million inhabitations is substantially below that of the EU. Scientific articles 
are  of  lower  quality  as  only  a  small  share  is  among  the  top-10%  most  cited  papers.  The 
number of international scientific co-publications is also relatively low. 

  Iceland 

For Iceland, data are missing for only two indicators. For 10 indicators performance is above 
that  of  the  EU  and  for  three  indicators  performance  is  below  that  of  the  EU.  Iceland  is 
spending 2.81% of its GDP on R&D, with almost 7,000 researchers per million inhabitants, 
resulting in a very high number of international scientific co-publications. The share of open 
access publications is above that of the EU. Scientific articles are of good quality as almost 
11%  are  among  the  top-10%  most  cited  papers.  A  small  share  of  innovative  enterprises 
collaborates with higher education institutes and public research organisations. A large share 
of researchers receives transferable skills training. Direct and indirect government support to 
business enterprises’ R&D is below that of the EU. A relatively small share of public R&D 
expenditures is financed by the business sector. 

  Israel 

For  Israel,  data  are  missing  for  almost  half  (seven)  indicators.  The  performance  of  two 
indicators is above that of the EU and the performance of six indicators is below that of the 
EU.  Israel  is  spending  a  very  high  share  of  its  GDP  on  R&D  (5.56%),  resulting  in  a  high 
number of international scientific co-publications. The share of open access publications is 
close  to  that  of  the  EU.  Scientific  articles  are  of  relatively  good  quality  as  almost  9%  are 
among the top-10% most cited papers. Direct and indirect government support to business 
enterprises’ R&D is below that of the EU. 

  Montenegro 

For Montenegro, data are missing for five indicators. The performance of four indicators is 
above that of the EU and the performance of six indicators is below that of the EU. Gross 
Domestic Expenditure on R&D is relatively low at 0.50% of GDP. The share of open access 
publications is close to that of the EU. Scientific articles are of relatively low quality with less 
than 5% being among the top-10% most cited papers. Direct and indirect government support 

49 

 
 
 
 
 
to business enterprises’ R&D is close to 0% of GDP. A relatively large share of public R&D 
expenditures is financed by the business sector. 

  Norway 

For Norway, the performance of 12 indicators is above that of the EU and the performance 
of three indicators is below that of the EU. Norway is spending 1.94% of its GDP on R&D, 
with  more  than  7,000  researchers  per  million  inhabitants,  resulting  in  a  high  number  of 
international scientific co-publications. The share of open access publications is above that 
of  the  EU.  A  small  share  of  innovative  enterprises  collaborates  with  higher  education 
institutes and public research organisations. Scientific articles are of good quality as almost 
11%  are  among  the  top-10%  most  cited  papers.  A  large  share  of  researchers  receives 
transferable skills training. Direct and indirect government support to business enterprises’ 
R&D is above that of the EU. A relatively small share of public R&D expenditures is financed 
by  the  business  sector.  Government  budget  allocations  for  R&D  (GBARD)  allocated  to 
Europe-wide transnational, as well as bilateral or multilateral, public R&D programmes per 
FTE researcher are above that of the EU. 

  Serbia 

For Serbia, data are missing for three indicators. The performance of four indicators is above 
that of the EU and the performance of eight indicators is below that of the EU. Gross Domestic 
Expenditure  on  R&D  is  relatively  low  at  almost  1%  of  GDP.  The  share  of  open  access 
publications is close to that of the EU. A small share of innovative enterprises collaborates 
with higher education institutes and public research organisations. Scientific articles are of 
relatively low quality with close to 5% being among the top-10% most cited papers. Direct 
and indirect government support to business enterprises’ R&D is below that of the EU. A very 
small  share  of  public  R&D  expenditures  is  financed  by  the  business  sector.  Government 
budget  allocations  for  R&D  (GBARD)  allocated  to  Europe-wide  transnational,  as  well  as 
bilateral or multilateral, public R&D programmes per FTE researcher are below that of the 
EU. 

  Türkiye 

For Türkiye, data are missing for only two indicators. The performance of four indicators is 
above  that  of  the  EU  and  for  nine  indicators  performance  is  below  that  of  the  EU.  Gross 
Domestic Expenditure on R&D is relatively low at 1.13% of GDP. The share of open access 
publications is below that of the EU. A small share of innovative enterprises collaborates with 
higher  education  institutes  and  public  research  organisations.  Scientific  articles  are  of 
relatively low quality with almost 7.5% being among the top-10% most cited papers. Direct 
and  indirect  government  support  to  business  enterprises’  R&D is  above  that  of  the  EU.  A 
share of public R&D expenditures is financed by the business sector. 

50 

 
 
 
 
 
 
7.  Conclusions 

The  first  edition  of  the  new  ERA  Scoreboard  analyses  data  for  15  of  the  18  included 
indicators, with two indicators measuring progress in the European Research & Innovation 
system and 16 specific indicators, one for each Pact for R&I priority. 

For  each  of  the  indicators  an  EU  trend  performance  has  been  evaluated  for  three  time 
periods, from 2010 to present, from 2015 to present, and for the last three years. Based on 
the number of times the trend was positive in each of these periods, an indicator is considered 
to  have  made  substantial  positive  change,  slower  positive  change,  or  little  to  no  positive 
change, irrespective of the size of the improvement. 

The results of the ERA Scoreboard 2023 show that for the EU there has been substantial 
positive change in the following five Pact for R&I priorities: 

•  R&D investments 

•  Gender equality 

•  Global engagement 

•  Synergies with sectorial policies and industrial policies 

•  Coordination of R&I investments. 

The EU has shown slower positive change in the following three Pact for R&I priorities: 

•  Researchers’ careers and mobility 

•  Knowledge Valorisation 

•  Active citizen and societal engagement in R&I. 

The EU has shown limited positive change in the following five Pact for R&I priorities: 

•  Scientific leadership 

•  Challenge-based ERA actions 

•  Synergies with education and the European Skills Agenda 

•  More investments and reforms in countries and regions with lower R&I performance 

•  Support to prioritise and secure long-term R&I investments and policy reforms 

Data  availability  for  the  selected  eight  Horizon  Associated  Countries  is  relatively  poor,  in 
particular for Armenia and Georgia. 

While considering the challenges attached to the indicators and the related data, the results 
indicate that still some additional effort would be beneficial mainly in the priority areas where 
“limited positive change” can be observed. These preliminary results need to be scrutinised 
by future Scoreboards, but might also be reflected in the future ERA Policy Agendas. 

51 

 
 
 
 
ANNEXES SHOWING LATEST INDICATOR VALUES AND CHANGES 
OVER TIME FOR EACH OF THE ERA-SCOREBOARD INDICATORS 

Annex 1 Gross Domestic Expenditure on R&D as a percentage of GDP 

Country 
European Union 
Belgium 
Bulgaria 
Czechia 
Denmark 
Germany 
Estonia 
Ireland 
Greece 
Spain 
France 
Croatia 
Italy 
Cyprus 
Latvia 
Lithuania 
Luxembourg 
Hungary 
Malta 
Netherlands 
Austria 
Poland 
Portugal 
Romania 
Slovenia 
Slovakia 
Finland 
Sweden 
Armenia 
Georgia 
Iceland 
Israel 
Montenegro 
Norway 
Serbia 
Türkiye 

Latest (2021) 
2.26 
3.22 
0.77 
2.00 
2.81 
3.13 
1.75 
1.06 
1.45 
1.43 
2.21 
1.24 
1.48 
0.87 
0.69 
1.11 
1.02 
1.65 
0.64 
2.25 
3.19 
1.44 
1.68 
0.47 
2.14 
0.93 
2.99 
3.35 
0.21 
0.25 
2.81 
5.56 
0.50 
1.94 
0.99 
1.13 

Change since 
2010 
0.29 
1.16 
0.21 
0.67 
-0.11 
0.40 
0.17 
-0.53 
0.85 
0.07 
0.03 
0.51 
0.26 
0.43 
0.08 
0.33 
-0.40 
0.52 
0.05 
0.55 
0.46 
0.72 
0.14 
0.02 
0.09 
0.32 
-0.72 
0.18 
-0.04 
-0.05 
0.41 
1.69 
0.19 
0.30 
0.29 
0.34 

Change since 
2015 
0.14 
0.79 
-0.18 
0.08 
-0.25 
0.20 
0.28 
-0.12 
0.48 
0.21 
-0.02 
0.41 
0.14 
0.39 
0.07 
0.07 
-0.23 
0.31 
-0.08 
0.10 
0.14 
0.44 
0.44 
-0.02 
-0.06 
-0.23 
0.12 
0.13 
-0.04 
-0.05 
0.63 
1.34 
0.13 
0.02 
0.18 
0.25 

Change in last 3 
years 
0.04 
0.06 
-0.06 
0.07 
-0.12 
-0.04 
0.12 
-0.17 
0.17 
0.18 
0.02 
0.16 
0.02 
0.16 
0.05 
0.12 
-0.16 
0.18 
0.08 
0.07 
0.06 
0.12 
0.28 
-0.01 
0.10 
0.11 
0.19 
-0.04 
0.03 
-0.03 
0.49 
0.34 
0.00 
-0.20 
0.10 
0.07 

Change since 
last year 
-0.04 
-0.13 
-0.08 
0.01 
-0.15 
0.00 
0.00 
-0.17 
-0.06 
0.02 
-0.09 
0.00 
-0.03 
0.03 
0.00 
-0.03 
-0.07 
0.06 
-0.01 
-0.06 
-0.01 
0.05 
0.07 
0.00 
0.00 
0.03 
0.08 
-0.14 
0.00 
-0.05 
0.34 
-0.15 
0.00 
-0.30 
0.08 
0.04 

52 

 
 
 
 
Annex 2 Researchers (in full-time equivalent) per million inhabitants 

Country 
European Union 
Belgium 
Bulgaria 
Czechia 
Denmark 
Germany 
Estonia 
Ireland 
Greece 
Spain 
France 
Croatia 
Italy 
Cyprus 
Latvia 
Lithuania 
Luxembourg 
Hungary 
Malta 
Netherlands 
Austria 
Poland 
Portugal 
Romania 
Slovenia 
Slovakia 
Finland 
Sweden 
Armenia 
Georgia 
Iceland 
Israel 
Montenegro 
Norway 
Serbia 
Türkiye 
Data are not available for Armenia and Israel. 

Latest (2021) 
4,483 
6,604 
2,347 
4,581 
7,708 
5,538 
4,037 
4,593 
4,150 
3,252 
5,025 
2,356 
2,916 
1,814 
2,391 
3,941 
5,051 
4,452 
2,060 
6,069 
6,163 
3,585 
5,473 
995 
5,249 
3,209 
7,871 
9,640 
N/A 
1,624 
6,944 
N/A 
4,763 
7,162 
789 
2,207 

Change since 
2010 
1,429 
2,838 
867 
1,788 
945 
1,528 
980 
1,477 
1,932 
355 
1,259 
705 
1,168 
709 
553 
1,204 
-154 
2,321 
642 
2,829 
1,783 
1,888 
1,546 
21 
1,486 
392 
130 
4,361 
N/A 
343 
-146 
N/A 
659 
1,718 
253 
703 

Change since 
2015 
955 
1,872 
370 
968 
142 
760 
853 
-159 
954 
616 
820 
849 
845 
803 
571 
1,145 
415 
1,884 
195 
1,129 
1,089 
1,412 
1,746 
117 
1,420 
551 
1,014 
2,794 
N/A 
343 
1,037 
N/A 
377 
1,233 
-73 
147 

Change in last 3 
years 
333 
1,313 
-73 
591 
15 
109 
267 
-207 
506 
184 
361 
192 
227 
156 
499 
494 
-41 
431 
157 
415 
203 
404 
592 
102 
200 
94 
624 
1,954 
N/A 
-75 
707 
N/A 
0 
425 
0 
120 

Change since 
last year 
264 
1,045 
-55 
448 
57 
118 
201 
-227 
143 
180 
249 
110 
284 
74 
256 
296 
128 
143 
95 
205 
333 
302 
309 
47 
75 
43 
322 
1,885 
N/A 
-89 
354 
N/A 
0 
397 
0 
57 

53 

 
 
 
Annex 3 Share of publications available in open access 

Country 

Latest (2019) 

Change since 
2010 

Change since 
2015 

Change in last 3 
years 

Change since 
last year 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

European Union 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

39.2 

43.2 

25.7 

34.1 

48.1 

39.9 

40.4 

44.1 

34.5 

44.8 

39.5 

50.7 

37.8 

38.3 

28.9 

44.3 

42.0 

54.3 

39.3 

58.3 

49.0 

40.9 

39.5 

25.1 

44.3 

30.8 

48.6 

52.9 

N/A 

N/A 

51.4 

36.7 

40.8 

53.7 

42.1 

5.2 

3.7 

-5.1 

0.6 

8.6 

6.3 

1.2 

3.4 

2.1 

6.6 

3.5 

-2.2 

4.1 

6.3 

-0.9 

3.7 

10.4 

20.1 

-4.4 

13.2 

14.4 

7.2 

0.4 

1.4 

8.1 

-3.7 

13.9 

14.7 

N/A 

N/A 

10.1 

-3.4 

-9.2 

17.4 

-1.5 

-2.6 
Türkiye 
Data are not available for Armenia and Georgia. 

29.8 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

54 

 
 
 
Annex 4 Share of women in grade A positions in higher education 

Country 
European 
Union 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

Latest 
(2018) 

Change 
since 
2010 

Change 
since 
2015 

Change 
in last 3 
years 

Change 
since 
last year 

Data available for years 
and variable 

Data imputed for years 

27.2 

20.3 

39.7 

N/A 

22.6 

20.5 

N/A 

25.6 

22.3 

23.9 

27.4 

33.3 

23.7 

13.3 

41.4 

40.4 

17.7 

21.6 

19.3 

22.3 

25.1 

24.6 

27.2 

40.6 

33.0 

27.2 

30.3 

28.2 

N/A 

N/A 

26.3 

19.5 

N/A 

30.9 

N/A 

4.9 

7.0 

13.8 

N/A 

6.5 

5.8 

N/A 

7.0 

2.6 

5.4 

8.1 

5.3 

3.7 

3.6 

9.2 

1.2 

0.0 

1.1 

1.8 

2.7 

5.8 

N/A 

2.5 

2.0 

N/A 

5.1 

0.8 

3.0 

1.7 

3.5 

2.2 

0.3 

2.3 

1.2 

0.0 

1.5 

-25.3 

-13.3 

9.2 

4.8 

2.8 

4.6 

15.0 

10.4 

4.7 

5.6 

5.9 

N/A 

N/A 

2.1 

5.7 

N/A 

8.0 

N/A 

4.2 

2.3 

1.3 

1.5 

1.0 

4.0 

2.5 

1.9 

2.9 

N/A 

N/A 

0.0 

5.2 

N/A 

3.8 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

0.5 

1.1 

1.5 

N/A 

1.2 

0.5 

N/A 

1.6 

0.0 

1.4 

0.0 

0.0 

0.7 

0.0 

0.0 

-4.1 

0.0 

1.0 

-0.7 

2.1 

0.0 

0.9 

0.2 

1.6 

1.3 

0.9 

0.2 

1.2 

N/A 

N/A 

0.0 

0.8 

N/A 

1.3 

N/A 

-- 

#2: 2011-18 

#1: 2010-18 

-- 

#1: 2010-18 

#1: 2010-18 

-- 

-- 

2010 

-- 

-- 

-- 

-- 

-- 

#1: 2014-18 

2010-12 

#1: 2012-13, 15-17 

2010-11, 14, 18 

#1: 2010-18 

-- 

#1: 2012, 15, 17 

2010-11, 13-14, 16, 18 

#1: 2014, 17, 19 

2010-13, 15-16, 18 

#1: 2010-18 

#2: 2010-17 

#1: 2010-16 

#1: 2017-18 

#1: 202016 

#2: 2010-18 

-- 

2018 

2017-18 

2010-16 

2010-15, 17-18 

-- 

#1: 2014, 16, 18 

2010-13, 15, 17 

#1: 2010-18 

-- 

#2: 2011, 13, 15, 17 

2010, 12, 14, 16, 18 

#1: 2012-18 

#2: 2010-18 

#1: 2010-18 

2010-11 

-- 

-- 

#1: 2013-15, 18 

2010-12, 16-17 

#1: 2012-13, 16, 18 

2010-11, 14-15, 17 

#2: 2011-18 

2010 

#1: 2011, 13, 15, 17-18 

2010, 12, 14, 16 

-- 

-- 

#1: 2010-12 

#1: 2014-18 

-- 

#2: 2011-18 

-- 

-- 

-- 

2013-18 

2010-13 

-- 

2010 

-- 

0.1 

0.4 

0.4 

N/A 

30.5 

Türkiye 
Data  are  available  for  two  variables:  #1  Proportion  (%)  of  women  among  grade  A  staff,  by  age  group  - 
Academic staff, and #2 Proportion (%) of women among grade A staff, by age group - Researchers. Not for all 
countries data are available for both variables. The table shows which data have been used for each country. 
Data  for  the  EU  have  been calculated  as the  unweighted  average of the shares  for  the  individual Member 
States,  with  all  countries  receiving  the  same  weight  irrespective  of  differences  in  absolute  number  of 
researchers  and  academic  staff  between  countries.  Data  are  not  available  for  Estonia,  Armenia,  Georgia, 
Montenegro and Serbia. 

#1: 2016-18 

2010-15 

55 

 
Annex 5 Job-to-job mobility of Human Resources in Science & Technology 

Country 
European Union 
Belgium 
Bulgaria 
Czechia 
Denmark 
Germany 
Estonia 
Ireland 
Greece 
Spain 
France 
Croatia 
Italy 
Cyprus 
Latvia 
Lithuania 
Luxembourg 
Hungary 
Malta 
Netherlands 
Austria 
Poland 
Portugal 
Romania 
Slovenia 
Slovakia 
Finland 
Sweden 
Armenia 
Georgia 
Iceland 
Israel 
Montenegro 
Norway 
Serbia 
Türkiye 
Data are not available for Ireland, Armenia, Georgia and Israel. 

Latest (2020) 
6.8 
6.5 
2.8 
4.3 
10.7 
8.8 
9.5 
N/A 
4.8 
6.9 
7.4 
6.9 
4.4 
10.5 
6.2 
10.8 
9.4 
6.7 
7.6 
8.7 
7.3 
6.8 
7.0 
1.4 
7.3 
3.4 
8.4 
4.0 
N/A 
N/A 
8.9 
N/A 
3.4 
9.2 
5.7 
7.1 

Change since 
2010 
1.3 
0.7 
0.1 
-0.7 
1.4 
1.9 
4.2 
N/A 
1.4 
1.7 
2.3 
3.3 
0.4 
3.1 
0.4 
3.1 
2.5 
3.4 
1.3 
0.9 
1.2 
1.0 
1.0 
-0.8 
1.0 
0.3 
1.2 
-0.2 
N/A 
N/A 
1.0 
N/A 
N/A 
0.6 
2.7 
0.9 

Change since 
2015 
0.9 
0.8 
0.0 
0.4 
0.2 
1.9 
2.9 
N/A 
1.3 
0.7 
1.4 
2.1 
0.6 
3.1 
0.3 
3.7 
1.1 
2.5 
0.5 
0.8 
0.9 
0.0 
0.9 
-1.0 
1.5 
0.1 
1.3 
-1.2 
N/A 
N/A 
-0.5 
N/A 
-0.9 
0.1 
1.1 
-1.3 

Change in last 3 
years 
-0.5 
-0.4 
0.4 
-0.9 
0.1 
-0.7 
-0.7 
N/A 
0.5 
-0.8 
-0.3 
-0.8 
0.2 
0.2 
0.8 
0.1 
-0.9 
1.7 
-3.1 
-0.8 
0.3 
-0.6 
-0.6 
-0.6 
1.3 
-0.7 
0.2 
-2.1 
N/A 
N/A 
-2.2 
N/A 
-0.4 
-0.2 
0.3 
-2.5 

Change since 
last year 
-0.8 
-0.6 
0.0 
-0.4 
0.0 
-1.1 
-1.1 
N/A 
-0.5 
-0.9 
-1.1 
0.5 
0.0 
0.3 
1.1 
0.2 
-0.6 
0.4 
-1.4 
-1.1 
-1.1 
-0.9 
-2.1 
-0.2 
0.7 
0.1 
-0.2 
-2.4 
N/A 
N/A 
-1.2 
N/A 
-0.2 
-0.5 
-0.4 
-1.3 

56 

 
 
 
Annex  6  Share  of  innovating  firms  collaborating  with  HEI/PRO  out  of  all 
innovative firms 

Country 

Latest (2020) 

Change since 
2010 

Change since 
2015 

Change in last 3 
years 

Change since 
last year 

European Union 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

13.3 

19.6 

5.0 

11.7 

15.3 

15.8 

14.9 

23.0 

13.6 

9.0 

13.2 

10.2 

9.9 

4.7 

11.2 

11.7 

12.0 

12.9 

8.1 

11.7 

23.2 

9.7 

8.5 

7.6 

19.3 

8.7 

24.6 

15.5 

N/A 

N/A 

14.1 

N/A 

N/A 

14.3 

16.9 

2.4 

1.3 

-0.7 

-0.4 

1.1 

2.2 

6.7 

12.5 

-2.3 

0.1 

1.7 

-2.2 

5.3 

-8.9 

3.7 

2.1 

1.6 

-2.8 

4.8 

2.0 

2.7 

1.3 

0.2 

3.8 

-1.2 

-5.6 

-10.1 

1.4 

N/A 

N/A 

1.7 

N/A 

N/A 

-1.4 

2.1 

0.7 

-3.0 

1.9 

-1.0 

0.8 

0.9 

-0.2 

11.9 

3.6 

-3.3 

1.3 

3.3 

3.1 

-1.8 

5.8 

2.9 

1.5 

2.5 

4.2 

-3.9 

1.8 

-1.6 

-1.2 

-0.5 

-0.2 

-1.3 

-3.4 

-1.7 

N/A 

N/A 

-2.8 

N/A 

N/A 

-2.8 

5.4 

-1.9 

-1.0 

-0.8 

-1.2 

-29.7 

-3.0 

-2.2 

-13.3 

-2.0 

-0.5 

-1.0 

-1.1 

-0.1 

-2.4 

3.2 

1.1 

1.3 

0.5 

1.7 

-1.6 

2.2 

-3.2 

-4.2 

3.1 

-2.5 

-3.1 

-6.2 

-0.7 

N/A 

N/A 

0.0 

N/A 

N/A 

1.6 

0.0 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

Türkiye 
Trend results for the last year are not available as these would be the same as those for the last 3 years for 
which the difference between 2018 and 2020 has been used. Data are not available for Armenia, Georgia, 
Israel and Montenegro. 

-10.0 

10.1 

15.9 

N/A 

8.2 

57 

 
 
 
Annex 7 Number of scientific publications among the top-10% most cited 
publications worldwide as a percentage of all publications 

Country 

Latest (2020) 

Change since 
2010 

Change since 
2015 

Change in last 3 
years 

Change since 
last year 

European Union 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

Türkiye 

9.8 

11.9 

2.4 

5.2 

12.2 

10.4 

8.8 

11.3 

9.2 

9.2 

8.9 

4.8 

12.2 

10.4 

5.0 

5.9 

12.8 

5.9 

8.8 

13.9 

10.3 

5.5 

8.8 

6.3 

7.9 

4.5 

11.8 

11.7 

2.1 

3.7 

10.7 

8.6 

4.2 

10.9 

5.3 

7.4 

0.0 

-0.4 

-0.1 

0.2 

-1.2 

-0.1 

-0.6 

-0.3 

0.3 

0.0 

0.1 

0.5 

1.2 

1.3 

0.8 

1.2 

1.7 

0.5 

3.1 

-1.1 

-0.4 

0.5 

-0.4 

1.4 

0.1 

0.7 

0.0 

-1.2 

-0.3 

0.5 

0.6 

-0.8 

-2.0 

-1.0 

0.6 

1.3 

0.0 

-0.3 

-0.3 

0.2 

-1.6 

-0.1 

0.1 

-0.1 

0.4 

-0.1 

0.1 

0.3 

1.0 

2.0 

1.6 

0.7 

-1.2 

-0.7 

3.4 

-1.0 

-0.4 

0.6 

-0.5 

0.7 

0.2 

0.4 

-0.6 

-0.9 

0.0 

0.0 

2.6 

-0.3 

1.2 

-0.6 

0.5 

1.1 

-0.3 

-1.1 

-0.7 

0.3 

-2.6 

-0.9 

1.1 

-0.4 

0.8 

-0.3 

-1.3 

1.9 

1.9 

1.4 

3.6 

2.6 

-0.4 

0.9 

2.0 

-2.1 

-0.7 

2.3 

-1.1 

2.9 

1.6 

1.6 

0.2 

-1.1 

1.1 

0.4 

-3.9 

-2.6 

1.5 

-1.5 

0.8 

1.8 

-0.3 

-1.8 

0.0 

0.6 

-2.2 

-0.9 

0.9 

-1.2 

0.1 

-0.1 

-0.7 

1.2 

1.2 

1.8 

1.1 

1.4 

0.2 

1.1 

-0.4 

-1.4 

-1.0 

1.0 

-0.5 

2.8 

1.0 

0.9 

0.4 

-1.4 

1.0 

1.5 

1.1 

-1.5 

2.0 

-1.7 

1.2 

2.3 

58 

 
 
 
 
Annex 8 International co-publications with non-EU (or foreign) partners per 
million population 

Country 

Latest (2021) 

Change since 
2010 

Change since 
2015 

Change in last 3 
years 

Change since 
last year 

European Union 

358.7 

141.3 

74.1 

38.0 

18.6 

With all foreign partners 

European Union 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

1,279.0 

2247.5 

404.7 

1316.8 

3698.4 

1207.5 

2136.2 

2373.9 

1184.3 

1178.0 

993.3 

1090.5 

1136.7 

3743.8 

781.6 

922.7 

3495.5 

757.4 

1575.9 

2475.6 

2266.0 

591.6 

1729.3 

395.2 

1941.5 

827.8 

2776.6 

2975.9 

256.1 

269.8 

4348.2 

1271.0 

736.6 

3358.2 

697.2 

618.8 

978.6 

178.1 

767.9 

2035.6 

475.7 

1415.4 

1226.7 

630.5 

604.5 

293.0 

729.6 

614.6 

2676.8 

625.9 

668.0 

2125.2 

374.4 

1223.3 

1110.8 

1088.2 

372.4 

1079.7 

233.7 

1016.7 

437.1 

1415.6 

1365.1 

130.3 

192.9 

1741.4 

338.5 

515.3 

1842.8 

457.2 

360.0 

499.2 

157.6 

440.5 

1081.1 

247.4 

953.6 

916.5 

409.9 

344.0 

111.1 

529.4 

394.7 

2282.1 

421.0 

449.6 

1086.8 

249.2 

773.1 

625.3 

617.9 

268.4 

648.2 

160.5 

568.6 

273.0 

798.9 

681.2 

45.2 

106.2 

1042.2 

163.8 

392.6 

1244.6 

294.4 

85.4 

142.9 

27.6 

76.9 

208.9 

62.4 

206.9 

293.3 

176.1 

63.1 

-19.2 

192.1 

92.1 

827.1 

61.3 

44.0 

595.1 

90.8 

433.2 

156.8 

166.9 

80.1 

165.8 

68.5 

166.5 

-31.8 

240.0 

168.7 

14.9 

19.9 

517.2 

0.0 

-40.1 

345.1 

118.3 

-5.5 

-37.8 

9.2 

-45.1 

-33.1 

-21.9 

-63.7 

5.1 

55.4 

-8.7 

-41.0 

81.2 

6.8 

358.7 

-35.0 

-48.1 

269.0 

14.0 

155.6 

-25.5 

-37.4 

22.1 

27.5 

36.5 

-79.4 

-50.4 

41.2 

-9.1 

0.0 

0.0 

188.7 

0.0 

-99.5 

93.9 

23.3 

203.1 

Türkiye 
Results  for  the  EU  in  the  first  row  only  include  co-publications  with  co-authors  outside  the  EU  are  not 
comparable to the results of the other countries as these include co-publications with all foreign co-authors, 
also including co-authors in other Member States. Comparable results for the EU are shown in the third row in 
italics. 

132.2 

96.2 

32.0 

0.0 

59 

 
 
 
Annex 9 Environmentally related government R&D budget as percentage 
of total government R&D 

Country 
European 
Union 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

Latest 
(2020) 

Change since 
2010 

Change since 
2015 

Change in last 3 
years 

Change since last 
year 

2.5 

0.6 

N/A 

2.1 

1.2 

2.7 

1.3 

2.0 

4.2 

3.1 

1.8 

N/A 

2.9 

N/A 

5.9 

0.3 

2.0 

4.3 

N/A 

0.7 

2.7 

N/A 

4.3 

N/A 

5.3 

2.9 

3.0 

1.8 

N/A 

N/A 

N/A 

N/A 

N/A 

3.1 

N/A 

-0.2 

-1.5 

N/A 

0.0 

-0.4 

-0.3 

-4.7 

0.8 

1.5 

-0.4 

0.1 

N/A 

0.0 

N/A 

0.2 

-1.7 

-2.1 

1.3 

N/A 

0.2 

1.8 

N/A 

1.0 

N/A 

2.0 

-0.3 

1.9 

-0.2 

N/A 

N/A 

N/A 

N/A 

N/A 

0.4 

N/A 

-0.5 

-1.4 

N/A 

-0.2 

-0.8 

-0.2 

-6.3 

1.0 

1.1 

-0.7 

-1.5 

N/A 

0.4 

N/A 

-2.0 

-1.9 

-0.6 

2.1 

N/A 

0.1 

2.0 

N/A 

-0.4 

N/A 

-0.9 

0.0 

1.9 

0.3 

N/A 

N/A 

N/A 

N/A 

N/A 

0.6 

N/A 

0.0 

-0.2 

N/A 

0.0 

0.1 

0.0 

-0.2 

0.7 

0.9 

-0.8 

0.1 

N/A 

0.1 

N/A 

1.7 

0.2 

-0.4 

1.8 

N/A 

0.1 

2.1 

N/A 

0.3 

N/A 

-0.3 

0.1 

0.4 

0.4 

N/A 

N/A 

N/A 

N/A 

N/A 

0.5 

N/A 

0.1 

-0.4 

N/A 

0.0 

0.3 

0.0 

0.6 

0.7 

-1.6 

-0.8 

0.4 

N/A 

0.4 

N/A 

1.0 

0.2 

-0.5 

0.4 

N/A 

0.1 

2.2 

N/A 

-0.3 

N/A 

-0.5 

-0.1 

0.7 

0.0 

N/A 

N/A 

N/A 

N/A 

N/A 

0.4 

N/A 

Türkiye 
Data are not available for 5 Member States (Bulgaria, Croatia, Cyprus, Malta, Poland and Romania) and for 6 
Horizon Europe Associated Countries. 

-0.1 

-1.1 

-0.1 

0.8 

0.0 

60 

 
 
 
Annex 10 Share of researchers receiving transferable skills training 

Country 

European Union 

Latest (2020) 
46.3 

Change since 
2010 
N/A 

Change since 
2015 
-3.2 

Change in last 3 
years 
N/A 

Change since 
last year 
N/A 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

61.0 

31.0 

44.7 

70.3 

35.1 

59.8 

46.0 

54.0 

45.8 

50.8 

54.2 

66.7 

N/A 

45.5 

46.5 

32.7 

72.8 

80.3 

54.9 

66.7 

41.4 

44.5 

89.4 

40.5 

42.7 

41.7 

48.8 

N/A 

N/A 

70.5 

N/A 

N/A 

50.9 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

-3.5 

-36.2 

-16.0 

9.4 

-8.5 

6.6 

-24.8 

0.0 

-20.6 

6.1 

-5.5 

17.0 

N/A 

-24.4 

1.2 

-32.8 

22.3 

0.0 

-6.9 

43.6 

-10.0 

4.3 

42.8 

-32.2 

-14.0 

-14.9 

-15.9 

N/A 

N/A 

0.0 

N/A 

N/A 

-21.1 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

Türkiye 
Data are not available for Cyprus and for 6 Horizon Europe Associated Countries (Armenia, Georgia, Israel, 
Montenegro, Serbia and Türkiye). 

N/A 

N/A 

N/A 

N/A 

N/A 

61 

 
 
 
Annex  11  Direct  government  support  and  Indirect  government  support 
through R&D tax incentives as a percentage of GDP 

Country 

European Union 

Latest (2020) 
0.182 

Change since 
2010 
0.031 

Change since 
2015 
0.021 

Change in last 3 
years 
0.006 

Change since 
last year 
0.005 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

0.319 

0.006 

0.119 

0.085 

0.067 

0.055 

0.208 

0.081 

0.102 

0.421 

0.114 

0.145 

0.030 

0.013 

0.040 

0.031 

0.230 

0.004 

0.258 

0.356 

0.147 

0.296 

0.023 

0.195 

0.060 

0.072 

0.139 

N/A 

N/A 

0.106 

0.104 

0.001 

0.235 

0.023 

0.103 

-0.001 

-0.023 

0.027 

-0.015 

-0.033 

0.029 

0.063 

-0.042 

0.027 

-0.135 

0.102 

0.016 

0.005 

0.016 

-0.014 

-0.027 

-0.028 

0.064 

0.133 

0.120 

0.175 

-0.036 

-0.075 

0.033 

0.005 

0.017 

N/A 

N/A 

0.053 

-0.031 

0.001 

0.105 

0.015 

0.126 
Türkiye 
Data are not available for Armenia and Georgia. 

0.202 

0.039 

-0.003 

-0.011 

0.016 

0.000 

0.021 

0.061 

0.038 

0.012 

0.026 

0.106 

-0.103 

0.022 

0.007 

0.011 

-0.010 

-0.013 

-0.036 

0.029 

0.091 

0.019 

0.087 

0.002 

0.007 

0.021 

0.021 

0.017 

N/A 

N/A 

0.000 

0.004 

0.000 

0.015 

-0.001 

0.049 

-0.022 

-0.002 

-0.009 

0.010 

-0.003 

0.008 

0.000 

0.036 

0.008 

0.023 

0.095 

-0.067 

0.012 

0.006 

0.008 

-0.006 

-0.004 

-0.026 

0.024 

0.083 

0.011 

0.053 

0.003 

-0.020 

0.018 

0.025 

0.019 

N/A 

N/A 

0.000 

0.010 

0.000 

0.008 

-0.004 

0.012 

0.083 

-0.004 

-0.015 

0.012 

-0.001 

-0.001 

-0.103 

0.048 

0.013 

0.011 

0.112 

0.051 

0.024 

0.008 

0.012 

-0.014 

-0.108 

-0.025 

0.038 

0.095 

0.100 

0.154 

-0.013 

0.005 

0.037 

0.002 

0.007 

N/A 

N/A 

0.000 

-0.011 

-0.002 

0.051 

0.000 

0.108 

62 

 
 
 
Annex 12 Research on social innovation per million population 

Country 

European Union 

Latest (2021) 
1.75 

Change since 
2010 
1.39 

Change since 
2015 
0.50 

Change in last 3 
years 
0.01 

Change since 
last year 
-0.01 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

1.99 

1.16 

0.86 

4.62 

0.66 

0.75 

0.40 

1.03 

2.87 

0.86 

7.68 

1.94 

4.46 

5.28 

2.50 

1.58 

0.82 

1.94 

6.35 

3.69 

0.37 

5.53 

0.10 

2.84 

0.37 

5.06 

2.31 

0.34 

0.00 

2.71 

0.11 

0.00 

8.16 

0.29 

1.26 

1.16 

0.19 

3.54 

0.50 

-2.26 

0.40 

1.03 

2.55 

0.58 

6.51 

1.72 

4.46 

4.80 

1.52 

1.58 

0.82 

-0.47 

4.67 

3.10 

0.13 

4.78 

0.05 

2.36 

0.37 

3.76 

1.57 

0.34 

0.00 

2.71 

0.11 

0.00 

7.55 

0.02 

0.30 

1.02 

-0.38 

0.91 

0.22 

-1.53 

-0.24 

0.85 

1.64 

0.21 

-0.13 

0.67 

4.46 

1.25 

-1.26 

-0.20 

0.72 

1.94 

0.49 

2.65 

-0.13 

1.39 

-0.30 

-0.55 

0.18 

1.04 

0.57 

0.34 

0.00 

2.71 

0.11 

0.00 

7.19 

0.29 

-0.89 

-0.56 

-0.08 

-0.20 

0.05 

-0.76 

-0.62 

0.19 

1.34 

-0.18 

-2.13 

-0.37 

1.04 

1.12 

0.36 

-0.05 

0.21 

1.94 

0.45 

-0.82 

0.21 

-1.08 

-0.20 

-1.00 

-0.18 

0.17 

0.06 

0.34 

0.00 

-0.09 

0.11 

0.00 

4.60 

0.00 

-0.53 

-0.28 

-0.36 

-2.59 

-0.13 

0.00 

-0.61 

0.19 

1.01 

0.23 

-1.44 

-0.39 

-1.17 

2.66 

-1.43 

-0.02 

-0.20 

-7.78 

0.78 

0.77 

-0.18 

0.48 

-0.36 

-1.93 

-0.37 

-0.73 

0.57 

0.34 

0.00 

-0.03 

0.11 

0.00 

4.25 

0.00 

Türkiye 
Data  on  the  number  of  publications  for  each  country  have  been  extracted  from  EU  OpenAIRE 
(https://explore.openaire.eu/search/advanced/research-outcomes) by searching for the number of publications 
with the following keywords: ‘social innovation’ or ‘social entrepreneurship’. 

-0.09 

0.17 

0.30 

0.23 

0.03 

63 

 
 
 
Annex 13 Increase in total R&D expenditure, expressed as a percentage of 
GDP 

Country 
Widening 
countries * 

European Union 

Belgium 

Bulgaria * 

Czechia * 

Denmark 

Germany 

Estonia * 

Ireland 

Greece * 

Spain 

France 

Croatia * 

Italy 

Cyprus * 

Latvia * 

Lithuania * 

Luxembourg 

Hungary * 

Malta * 

Netherlands 

Austria 

Poland * 

Portugal * 

Romania * 

Slovenia * 

Slovakia * 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

Türkiye 

Latest (2020) 

Change since 
2010 

Change since 
2015 

Change in last 3 
years 

Change since 
last year 

0.02 

-0.04 

-0.03 

-0.03 

-0.07 

-0.03 

-0.49 

-0.12 

-0.02 

-0.11 

-0.06 

-0.20 

-0.23 

-0.14 

0.01 

-0.08 

-0.11 

-0.06 

-0.05 

0.00 

-0.07 

-0.07 

0.07 

0.00 

-0.10 

-0.04 

-0.06 

0.02 

0.03 

-0.10 

0.05 

0.03 

-0.21 

0.01 

-0.05 

0.00 

-0.59 

0.00 

-0.42 

0.11 

-0.03 

-0.08 

-0.41 

-0.06 

-0.05 

-0.18 

0.04 

-0.15 

-0.17 

-0.30 

-0.14 

-0.20 

-0.15 

-0.07 

-0.10 

-0.07 

-0.17 

0.05 

-0.08 

-0.10 

-0.19 

-0.09 

-0.02 

-0.15 

0.02 

-0.10 

-0.04 

-0.04 

-0.24 

-0.03 

-0.07 

0.17 

-0.64 

0.00 

-0.43 

0.06 

-0.03 

-0.04 

-0.19 

-0.04 

0.01 

-0.15 

0.00 

0.01 

-0.17 

-0.07 

0.02 

-0.09 

0.02 

-0.02 

0.04 

0.00 

-0.02 

-0.06 

0.04 

-0.01 

-0.06 

0.00 

0.05 

0.07 

0.01 

0.00 

0.04 

0.07 

-0.14 

0.00 

-0.05 

0.32 

-0.15 

0.00 

-0.31 

0.08 

0.00 

-0.09 

-0.30 

-0.01 

-0.20 

-0.17 

-0.08 

-0.72 

-0.13 

-0.15 

0.05 

-0.10 

0.02 

0.00 

0.03 

-0.11 

-0.14 

-0.06 

-0.01 

-0.09 

-0.24 

0.06 

0.02 

0.15 

-0.03 

-0.36 

-0.01 

0.16 

-0.16 

0.00 

-0.05 

0.32 

-0.22 

0.00 

-0.29 

0.10 

0.00 

-0.05 

-0.25 

-0.20 

0.05 

-0.30 

-0.05 

-0.03 

0.17 

-0.20 

0.04 

-0.09 

-0.04 

-0.02 

0.07 

0.07 

-0.03 

-0.09 

0.04 

-0.04 

-0.04 

0.03 

-0.01 

0.12 

-0.10 

0.17 

-0.24 

0.35 

-0.26 

0.00 

-0.05 

0.08 

-0.25 

-0.01 

-0.53 

-0.01 

-0.02 

64 

 
 
 
 
 
 
 
 
 
 
Annex 14 Share of public R&D expenditures financed by the private sector 

Country 

European Union 

Latest (2020) 
7.9 

Change since 
2010 
-0.7 

Change since 
2015 
-0.4 

Change in last 3 
years 
-0.1 

Change since 
last year 
0.2 

0.2 

4.3 

-1.1 

-0.1 

-0.4 

0.7 

0.2 

-1.0 

0.2 

-0.1 

3.3 

0.0 

0.9 

1.6 

-0.9 

0.1 

-3.7 

0.5 

-0.9 

0.0 

-1.0 

0.0 

2.3 

-1.8 

-0.3 

-0.3 

-0.8 

N/A 

N/A 

1.8 

N/A 

-16.2 

0.2 

0.0 

-3.5 

0.0 

0.2 

-0.5 

0.6 

-0.3 

0.0 

0.0 

-0.8 

-0.2 

0.2 

3.2 

-0.1 

0.1 

1.3 

0.0 

-0.4 

-0.7 

0.3 

-0.4 

0.0 

-0.5 

0.2 

2.3 

-0.5 

-0.1 

-0.3 

0.0 

N/A 

N/A 

2.6 

N/A 

9.5 

0.2 

0.0 

-0.2 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

9.9 

10.8 

3.2 

2.6 

11.6 

6.6 

3.7 

5.2 

6.3 

4.7 

4.6 

5.2 

1.9 

7.7 

7.2 

2.2 

2.2 

1.7 

7.9 

6.0 

2.9 

2.4 

12.7 

6.6 

2.0 

3.8 

3.2 

N/A 

N/A 

4.8 

N/A 

14.9 

3.8 

0.1 

0.6 

4.9 

-0.1 

-0.4 

-0.1 

2.8 

1.5 

-2.9 

-1.3 

0.3 

-2.7 

2.9 

0.7 

-5.5 

-7.7 

0.6 

-10.9 

0.2 

-2.7 

1.0 

-1.7 

1.3 

-0.4 

-5.9 

-5.9 

-3.1 

-1.0 

N/A 

N/A 

-2.9 

N/A 

12.4 

-2.1 

-9.3 

1.1 
Türkiye 
Data are not available for Armenia, Georgia and Israel. 

-8.1 

-0.9 

4.1 

-0.2 

0.2 

-1.1 

1.9 

1.1 

-1.1 

0.5 

-0.1 

-3.5 

2.9 

1.4 

-3.2 

-4.8 

1.0 

-6.2 

1.0 

0.1 

0.6 

-0.6 

0.5 

0.7 

-2.8 

-2.4 

-1.1 

-0.8 

N/A 

N/A 

0.9 

N/A 

-16.2 

-0.7 

0.0 

-4.9 

65 

 
 
 
 
Annex  15  Government  budget  allocations  for  R&D  allocated  to  Europe-
wide  transnational,  as  well  as  bilateral  or  multilateral,  public  R&D 
programmes per FTE researcher 

Country 

European Union 

Latest (2021) 
1,788.8 

Change since 
2010 
-147.1 

Change since 
2015 
-184.7 

Change in last 3 
years 
-0.5 

Change since 
last year 
-159.1 

Belgium 

Bulgaria 

Czechia 

Denmark 

Germany 

Estonia 

Ireland 

Greece 

Spain 

France 

Croatia 

Italy 

Cyprus 

Latvia 

Lithuania 

Luxembourg 

Hungary 

Malta 

Netherlands 

Austria 

Poland 

Portugal 

Romania 

Slovenia 

Slovakia 

Finland 

Sweden 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

3,918.1 

139.4 

597.2 

503.0 

2,185.1 

1,751.6 

1,288.8 

518.5 

2,134.6 

N/A 

849.8 

3,784.3 

2,684.3 

715.9 

506.7 

3,567.7 

153.0 

287.4 

1,037.2 

2,069.3 

383.7 

283.2 

339.6 

1,156.0 

341.1 

998.9 

1,733.1 

N/A 

N/A 

N/A 

N/A 

N/A 

2,075.1 

1,374.6 

-488.5 

82.6 

-241.6 

-375.3 

91.8 

1,084.3 

294.6 

-660.1 

-71.4 

N/A 

267.1 

55.7 

674.5 

535.7 

410.7 

2,902.2 

104.5 

248.5 

-1,359.2 

-333.7 

-55.2 

-81.0 

-360.5 

304.8 

309.9 

-586.5 

-699.0 

N/A 

N/A 

N/A 

N/A 

N/A 

-423.5 

1,301.1 

-545.0 

100.6 

-148.8 

-475.5 

29.6 

877.9 

462.1 

-22.0 

359.7 

N/A 

129.2 

-807.1 

923.7 

17.9 

297.4 

1,791.0 

-205.0 

142.3 

-368.8 

-177.8 

-247.7 

-475.2 

-992.9 

518.8 

132.0 

-672.3 

-330.3 

N/A 

N/A 

N/A 

N/A 

N/A 

-103.1 

843.7 

141.3 

7.3 

66.7 

25.4 

101.6 

1,379.2 

320.1 

172.0 

173.9 

N/A 

-43.2 

-65.6 

-879.1 

-578.2 

295.5 

996.3 

-41.1 

86.1 

-64.0 

-344.9 

-84.2 

-125.8 

-729.1 

137.6 

196.1 

-314.1 

-417.9 

N/A 

N/A 

N/A 

N/A 

N/A 

-72.0 

865.5 

N/A 
Türkiye 
Data are not available for France, Armenia, Georgia, Iceland, Israel, Montenegro and Türkiye. 

N/A 

N/A 

N/A 

-700.2 

12.1 

40.6 

-146.8 

92.9 

1,172.9 

373.5 

-94.8 

-377.4 

N/A 

278.0 

-777.5 

-447.7 

-143.7 

382.0 

1,163.1 

7.5 

111.3 

-251.4 

-283.1 

-73.6 

-140.9 

-41.2 

79.6 

120.8 

-439.7 

-495.0 

N/A 

N/A 

N/A 

N/A 

N/A 

43.6 

1,328.0 

N/A 

66 

 
 
 
Annex 16 Country abbreviations 

Member States 

Horizon Associated countries 

Armenia 

Georgia 

Iceland 

Israel 

Montenegro 

Norway 

Serbia 

Türkiye 

AT 

BE 

BG 

CY 

CZ 

DE 

DK 

EL 

EE 

ES 

FI 

FR 

HR 

HU 

IE 

IT 

LT 

LU 

LV 

MT 

NL 

PL 

PT 

RO 

SE 

SI 

SK 

Austria 

Belgium 

Bulgaria 

Cyprus 

Czechia 

Germany 

Denmark 

Greece 

Estonia 

Spain 

Finland 

France 

Croatia 

Hungary 

Ireland 

Italy 

Lithuania 

Luxembourg 

Latvia 

Malta 

Netherlands 

Poland 

Portugal 

Romania 

Sweden 

Slovenia 

Slovakia 

AR 

GE 

IS 

IL 

ME 

NO 

RS 

TR 

67 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
  
 
GETTING IN TOUCH WITH THE EU 

In person 
All over the European Union there are hundreds of Europe Direct centres. You can find the 
address of the centre nearest you online (european-union.europa.eu/contact-eu/meet-us_en). 

On the phone or in writing 
Europe Direct is a service that answers your questions about the European Union. 
You can contact this service: 
  by freephone: 00 800 6 7 8 9 10 11 (certain operators may charge for these calls), 
  at the following standard number: +32 22999696,  
  via the following form: european-union.europa.eu/contact-eu/write-us_en. 

FINDING INFORMATION ABOUT THE EU 

Online 
Information about the European Union in all the official languages of the EU is available on 
the Europa website (european-union.europa.eu). 

EU publications 
You can view or order EU publications at op.europa.eu/en/publications. Multiple copies of free 
publications can be obtained by contacting Europe Direct or your local documentation centre 
(european-union.europa.eu/contact-eu/meet-us_en). 

EU law and related documents 
For access to legal information from the EU, including all EU law since 1951 in all the official 
language versions, go to EUR-Lex (eur-lex.europa.eu). 

EU open data 
The portal data.europa.eu provides access to open datasets from the EU institutions, bodies 
and agencies. These can be downloaded and reused for free, for both commercial and non-
commercial purposes. The portal also provides access to a wealth of datasets from European 
countries. 

 
 
 
 
 
 
 
This report provides the results of the 2023 edition of the 
ERA Scoreboard. The ERA Scoreboard is one of the 
components of the new ERA Monitoring Mechanism, 
covering 18 indicators, including two general indicators 
measuring progress in the European Research & Innovation 
(R&I) system and 16 specific indicators, one for each Pact 
for R&I priority. 

Research and Innovation policy