D5.2 KPIs for Open Science in transport evaluation
Creators: name: Palts, Kristel
name: Akac, Attila
name: Anagnostopoulou, Afroditi
name: Michelmann, Jakob
Publisher: name: Zenodo
Year: 2021

description: The objective of Task 5.2 is to present the main KPIs for evaluating the Open Science services in transport research. More detailed, task 5.2 aims at developing proper Key Performance Indicators (KPIs) for assessing Open Science in transport in terms of validity or not. The main objective is to determine proper criteria and measures that will be used to evaluate the performance of Open Science in transport research. The proper assessment of the Open Science in transport will embed an on-going analysis which will help to assess the proper critical success factors such as transport research policies, transport research projects per mode of transport, transport research infrastructures and software per mode of transport or per EU country member state, transport research publications per mode of transport or per transport research policy. This Deliverable is the second step in the strategic development carried out in BE OPEN WP5 – “Guidelines for promoting Open Science”. With the elaboration of an initial list of KPIs for monitoring the system, this report contributes to measure effective implementation of Open Science in transport research data. The work carried out has been based on literature review and using information gathered in BE OPEN project, including input from Deliverables D5.1 “Identifying barriers, challenges and opportunities for Open Science” and D3.2 “TOPOS development”. This deliverable builds up on two main sections. The first chapter is dedicated to mapping the situation and paving the way for KPIs in Open Science research data in general and for international guidelines by highlighting the most important areas that should be considered for successful monitoring and evaluation of Open Science implementation in the research sector. In order to focus on transport and transport research data, information mainly deriving from BE OPEN Project activities has been considered to highlight the challenges and opportunities of Open Science in such a sector together with key stakeholders identified. The successful selection of KPIs, by analyzing the challenges and opportunities of Open Science in transport sector, recognize the critical success factors, which need to be monitored for successful implementation of Open Science. In that framework, stakeholders play a key role and are an important factor as they create, use and share the data. The other key point is TOPOS – the Transport fOrum / Observatory for Promoting Open Science – an important tool for transport research data, developed within the BE OPEN project and which aims to create a solid knowledge base on the implementation of Open Science approaches and therefore a key factor for successful KPIs development. With this regards, guidelines and recommendation from European Open Science Cloud SRIA have been used. The second chapter introduces a methodology for the initial set of KPIs. This includes the identification of key stakeholders to establish the essential user groups. The developed KPIs have been then clustered into operational and strategical ones. Operational KPIs including the identified opportunities and European Open Science Cloud KPI recommendations are focused on TOPOS. The strategical KPIs are based on the main challenges identified and are aiming to measure the overall success of Open Science implementation in the transport sector. In addition, a possible measuring criterion for the operational and strategic KPIs has been proposed to create extra value for the deliverable. A comprehensive list of initial KPIs is being proposed. Further actions to successfully consolidate and implement the set of indicators encompass the involvement of all stakeholders, for instance by organizing thematic needed, and workshops, to enter into the discussion.
description: {"references": ["Palts Kristel, Akac Attila, Anagnostopoulou Afroditi, Michelmann Jakob. (2021). D5.2 KPIs for Open Science evaluation in transport. Zenodo."]}