ELIXIR-CONVERGE D5.4 Report on KPI

Anne-Françoise Adam-Blondon, Laura Portell-Silva, Salvador Capella-Gutierrez, Marina Popleteeva, Inge Jonassen, Federico Bianchini, Espen Åberg, Adam Hospital, Nils-Peder Willassen, Ferran Sanz, et al.

► To cite this version:

Anne-Françoise Adam-Blondon, Laura Portell-Silva, Salvador Capella-Gutierrez, Marina Popleteeva, Inge Jonassen, et al. ELIXIR-CONVERGE D5.4 Report on KPI. ELIXIR. 2023. hal-04503565

HAL Id: hal-04503565

https://hal.inrae.fr/hal-04503565v1

Submitted on 8 Apr 2025

**HAL** is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Deliverable D5.4 Report on KPI

<table><tr><td>Project Title<br/>(Grant agreement no.):</td><td colspan="3">ELIXIR-CONVERGE: Connect and align ELIXIR Nodes to deliver sustainable FAIR life-science data management services (871075)</td></tr><tr><td>Project Acronym (EC Call):</td><td colspan="3">ELIXIR-CONVERGE (H2020-INFRADEV-2018-2020)</td></tr><tr><td>WP No & Title:</td><td colspan="3">WP5 Demonstrator Projects</td></tr><tr><td>WP leader(s):</td><td colspan="3">Anne-Françoise Adam-Blondon</td></tr><tr><td>Deliverable Lead<br/>Beneficiary:</td><td colspan="3">23 - UiB</td></tr><tr><td>Contractual delivery date:</td><td>30/05/2023</td><td>Actual delivery date:</td><td>26/06/2023</td></tr><tr><td>Delayed:</td><td colspan="3">1 month</td></tr><tr><td>Partner(s) contributing to<br/>this deliverable:</td><td colspan="3">UIB, HITS, BSC, INRAE, CNRS, UNILU</td></tr><tr><td colspan="4">Authors: Anne-Françoise Adam-Blondon (INRAE), Laura Portell-Silva (BSC), Salvador Capella-Gutierrez (BSC), Marina Popleteeva (UNILU)</td></tr><tr><td colspan="4">Contributors: Inge Jonassen (UiB); Federico Bianchini (UiO), Espen Åberg (UiB/UiT), Adam Hospital (IRB Barcelona), Nils P Willassen (UiB/UiT), Ferran Sanz (UPF), Ernesto Picardi (CNR), Pinar Alper (UNILU), Vilém Ded (UNILU), Nene Djenaba Barry (UNILU), Teresa d'Altri (CRG), Marko Vidak (UL), Corinne Martin (ELIXIR-hub)</td></tr><tr><td colspan="4">Acknowledgments (not grant participants):</td></tr><tr><td>Reviewers:</td><td colspan="3">ELIXIR-CONVERGE Management Board (MB) members.</td></tr></table>

## Log of changes

<table><thead><tr><td>DATE</td><td>Mvm</td><td>Who</td><td>Description</td></tr></thead><tbody><tr><td>09/06/2022</td><td>0v1</td><td>Anne-Françoise Adam-Blondon (INRAE)</td><td>Initial version</td></tr><tr><td>16/06/2023</td><td>0v2</td><td>Anne-Françoise Adam-Blondon (INRAE)</td><td>Sent to PMU after incorporating internal WP feedback</td></tr><tr><td>19/06/2023</td><td>0v3</td><td>Juan Arenas (ELIXIR Hub)</td><td>Circulated to the MB for final review before submission</td></tr></tbody></table>
<table><tr><td>26/06/2023</td><td>0v4</td><td>Anne-Françoise Adam-Blondon (INRAE)</td><td>MB comments addressed</td></tr><tr><td>05/07/2023</td><td>1v0</td><td>Nikki Coutts (ELIXIR Hub)</td><td>Final version to be uploaded into EC Portal</td></tr></table>

## Table of contents

<table><tr><td>1. Executive Summary</td><td>1</td></tr><tr><td>2. Contribution toward project objectives</td><td>2</td></tr><tr><td>3. Introduction</td><td>4</td></tr><tr><td>4. Description of work accomplished</td><td>5</td></tr><tr><td>4.1 Development of a first set of KPIs, allowing to monitor progress in the development of ELIXIR-CONVERGE resources in the context of the use cases</td><td>5</td></tr><tr><td>4.2 Assessment of the adoption by community of users</td><td>6</td></tr><tr><td>5. Results</td><td>7</td></tr><tr><td>4.1 Monitoring the progress in the development of CONVERGE's resources in the context of the use cases</td><td>7</td></tr><tr><td>4.2 Engagement of communities and success stories</td><td>9</td></tr><tr><td>4.2.1 - Assessment of dissemination efforts in the context of the use cases</td><td>9</td></tr><tr><td>4.2.2 - Success stories showing interest and adoption by communities of users</td><td>9</td></tr><tr><td>Use case 1. Harmonised FAIR plant genotype & phenotype data management toolkit for Europe</td><td>9</td></tr><tr><td>6. Conclusions</td><td>10</td></tr><tr><td>7. Impact</td><td>11</td></tr><tr><td>8. Next Steps</td><td>12</td></tr><tr><td>9. Deviation from Description of Action</td><td>13</td></tr></table>

## 1. Executive Summary

The overall goal of ELIXIR-CONVERGE's WP5 was, based on the analysis of a set of very diverse use cases, to contribute to the development of a set of resources supporting the development and implementation of Data Management Plans (DMPs) in national and transnational projects. Six use cases were considered to co-develop and test a method to address domain specific data management planning associated to a set of resources in collaboration with WP1, WP2 and WP3. In this context, another objective of WP5 was to develop, implement and refine key performance indicators (KPIs) in order to monitor the

<figure><img src="image_2.png" /></figure>
demonstrator projects' implementation of data management plans and possibly assess their adoption by the relevant community.

WP5 developed two sets KPIs in collaboration with WP4, in charge of developing KPIs across the entire ELIXIR-CONVERGE project and for assessing the impact of the project:

* a first set aiming at monitoring the development of guidance, resources for the development of DMP and for training in the context of the use cases

* a second set aiming at addressing the adoption of these resources by relevant communities of users as a way to assess the impact of the work achieved

In parallel, in order to ensure long term maintenance/update of the developed resources and to increase their impact, WP5 started to engage with ELIXIR communities that could be natural owners of these resources.

The KPI developed and collected by WP5 during the ELIXIR-CONVERGE project were useful to follow the partner's progress in the development and test of a sort of starter kit for domain specific data management support. Success stories could be collected showing adoption by communities and new projects and were mapped on ELIXIR's categories of impacts showing already "hits" on several of these.

## 2. Contribution toward project objectives

With this deliverable, the project has reached or the deliverable has contributed to the following objectives/key results:

<table><thead><tr><th>Objective no. / Key Result no. Description</th><th>Contributed to:</th></tr></thead><tbody><tr><td colspan="2"><strong>Objective 1: Develop a sustainable and scalable operating model for transnational life-science data management support by leveraging national capabilities (WP1, WP5)</strong></td></tr><tr><td><strong>Key Result 1.1:</strong> Established European expert network of data stewards that connect national data centres and similar infrastructures and drive the development of interoperable solutions following international best practice, including national interpretations of the General Data Protection Regulation (GDPR)</td><td>No</td></tr><tr><td><strong>Key Result 1.2:</strong> Development of joint guidelines and common toolkit that are adopted into funder recommendations, with support available nationally and in local languages</td><td>No</td></tr><tr><td><strong>Key Result 1.3:</strong> The catalogue of successful national business models</td><td>No</td></tr></tbody></table>

<figure><img src="image_3.png" /></figure>
<table><tr><td>incorporated into national strategies</td><td></td></tr><tr><td><strong>Key Result 1.4:</strong> The developed "sustainable and scalable operating model for transnational life-science data management support" is adopted into national ELIXIR Node</td><td><strong>No</strong></td></tr><tr><td colspan="2"><strong>Objective 2:</strong> Strengthen Europe's data management capacity through a comprehensive training programme delivered throughout the European Research Area (WP2, WP6)</td></tr><tr><td><strong>Key Result 2.1:</strong> A comprehensive ELIXIR Training and Capacity building programme in Data Management, directed at both data managers and ELIXIR users, and connected to the national training programmes in Data Management in the ELIXIR Nodes and prospective ELIXIR Member countries.</td><td><strong>No</strong></td></tr><tr><td><strong>Key Result 2.2:</strong> Development of a collective group of trainers that support scalable deployment of Data Management training across ELIXIR Nodes.</td><td><strong>No</strong></td></tr><tr><td><strong>Key Result 2.3:</strong> A substantial cohort of data managers, Node coordinators and researchers with specific data management skills, business planning and knowledge of transnational operations across the ELIXIR Nodes</td><td><strong>No</strong></td></tr><tr><td colspan="2"><strong>Objective 3:</strong> Align national data management standards and services through a sustainable, scalable and cost-effective data management toolkit (WP2, WP3, WP5)</td></tr><tr><td><strong>Key Result 3.1:</strong> Assemble a full-stack harmonised common toolkit comprising all aspects of data management: from data capture, annotation, and sharing; to integration with analysis platforms and making the data publicly available according to international standards.</td><td><strong>No</strong></td></tr><tr><td><strong>Key Result 3.2:</strong> Provide exemplar toolkit configurations for prioritised demonstrators to serve as templates for future use.</td><td><strong>No</strong></td></tr><tr><td><strong>Key Result 3.3:</strong> Establish national capacity in using as well as updating, extending and sustaining the toolkit across the ERA.</td><td><strong>No</strong></td></tr><tr><td><strong>Key Result 3.4:</strong> Enable 'FAIR at source' practice for data generation, and analytical process pipeline implementation by flexible deployment of the toolkit in national operations</td><td><strong>No</strong></td></tr><tr><td colspan="2"><strong>Objective 4:</strong> Align national investments to drive local impact and global influence of ELIXIR (WP4, WP6)</td></tr><tr><td><strong>Key Result 4.1:</strong> Development of a Node Impact Assessment Toolkit based on RI-PATHS methodology.</td><td><strong>Yes</strong></td></tr><tr><td><strong>Key Result 4.2:</strong> Adoption of Impact assessment in ELIXIR Nodes, supported by Node coordinators network and feedback on applicability from dialogues with national funders.</td><td><strong>Yes</strong></td></tr></table>

<figure><img src="image_4.png" /></figure>
<table><tr><td>**Key Result 4.3:** Creation of national public-private partnerships and industry outreach where open life-science data and services stimulate local bioeconomy</td><td>Yes</td></tr><tr><td>**Key Result 4.4:** Growth in reach, impact and engagement of stakeholder communication assessed by established ELIXIR Communications metrics</td><td>Yes</td></tr><tr><td>**Key Result 4.5:** Initiating and advancing discussions on Membership (EU and international) or strategic partnerships (international countries) following ELIXIR-CONVERGE workshops.</td><td>No</td></tr></table>

## 3. Introduction

The overall goal of ELIXIR-CONVERGE's WP5 was, based on the analysis of a set of very diverse use cases<fnref n="1" />, to contribute to the development of a set of resources supporting the development and implementation of Data Management Plans (DMPs) in national and transnational projects. Six use cases were considered:

1. Harmonised FAIR plant genotype & phenotype data management toolkit for Europe

2. Reproducible, comparable and FAIR Epitranscriptomics

3. Common Data management plans for the marine metagenomics Community

4. Federated access to human genomics data: GDPR

5. FAIR encoding and access to Toxicology data

6. FAIR organisation of biomolecular simulation information

These efforts resulted in the development of a method to address domain specific data management planning associated to a set of resources co-produced by WP1, WP2 and WP3: the RDMkit and its content<fnref n="2" />, the Data Stewardship Wizard (DSW) and its knowledge model<fnref n="3" /> as well as the learning path templates and guidance developed by the ELIXIR Training platform. ELIXIR-CONVERGE WP5 co-developed DMP guidance through the development of new RDMkit pages and DSW improvements<fnref n="4" />,<fnref n="5" /> as well as an analysis of training resources and gaps through the development learning paths in the context of its use cases<fnref n="6" />.

<figure><img src="image_5.png" /></figure>

<footnote n="1">¹ Adam-Blondon A-F, Alper P, Capella-Gutierrez S, Faria D, Portell Silva L, Hospital A, Willassen N-P (2021) ELIXIR-CONVERGE D5.1 Categorisation of the pilot projects. Zenodo. https://doi.org/10.5281/zenodo.4674491</footnote>

<footnote n="2">² https://rdmkit.elixir-europe.org/</footnote>

<footnote n="3">³ https://ds-wizard.org/</footnote>

<footnote n="4">⁴ Portell L, Capella-Gutierrez S, Alper P, d'Altri T, Hospital A, Åberg E, Faria D, Adam-Blondon A-F, Collin O, Willassen N-P, Lieby P, Oulas A, Paflis E, Jareborg N, Fatima N, Åkerström WN, Picardi E (2021) ELIXIR-CONVERGE D5.2 Report on the first two DMP processes. Zenodo. https://doi.org/10.5281/zenodo.5139903</footnote>

<footnote n="5">⁵ Capella-Gutierrez S, Popleteeva M, Bianchini F, Åberg E, Hooft R, Schuánek M, Slifka J, Hospital A, Willassen NP, Piñero J, Sanz F, Ramirez-Anguita JM, Pastor M, Mayer MA, Picardi E, Alper P, Ded V, Djenaba Barry N, Lieby P, d'Altri T, Faria D, Le Floch E, Rocca-Serra P, Droesbeke B, Bösl K, Vidak M (2023) Deliverable D5.5 Report on the remaining four DMP processes</footnote>

<footnote n="6">⁶ Leskošek B, Haurheeram V, Bianchini F, Alper P, Portell-Silva L, Åberg E, Hospital A, Popleteeva M, Willassen NP, Vidak M, Adam-Blondon A-F, Collin O, Curwin A, Freeberg M, Le Floch E, Lieby P, Picardi E, Capella-Gutierrez S (2023)</footnote>
Another objective of WP5 was to **develop, implement and refine key performance indicators (KPIs) in order to monitor the demonstrator projects' implementation of data management plans and possibly assess their adoption by the relevant community.** These KPIs should contribute to identifying potential gaps when implementing DMPs to be addressed in collaboration with WP1, WP2 and WP3. Finally, KPIs' use and adoption were to be evaluated with WP1 (Best practice, Operating models) and WP4 (Impact assessment) to produce relevant indicators which can be adopted beyond the proposal itself.

WP5 developed its KPIs after a round of discussions with WP5 partners but also with a
WP4 partner in charge of developing KPIs across the entire ELIXIR-CONVERGE project and
for assessing the impact of the project.

4. Description of work accomplished

ELIXIR-CONVERGE WP5 developed and collected two sets of KPIs:

* a first set aiming at monitoring the development of guidance, resources for the development of DMP and for training in the context of the use cases

* a second set aiming at addressing the adoption of these resources by relevant communities of users as a way to assess the impact of the work achieved

In parallel, in order to ensure long term maintenance/update of the developed resources and
to increase their impact, WP5 started to engage with ELIXIR communities that could be
natural owners of these resources.

4.1 Development of a first set of KPIs, allowing to monitor progress in the
development of ELIXIR-CONVERGE resources in the context of the use cases

The KPIs that allow monitoring the progress in terms of development of resources
supporting DMPs in the context of the use cases are quantitative. They are listed in Table 1.
They were collected at mid-term and end of the project. Each KPI was associated with a
target to be reached that was chosen by consensus with WP5's partners.

<figure><img src="image_6.png" /></figure>
<table><caption>**Table 1.** KPIs allowing to monitor the development of resources in support to Data Management Planning in the context of the Use Cases of ELIXIR-CONVERGE</caption><thead><tr><th>Category of resource</th><th>DMP templates</th><th colspan="2">Digital Resources</th><th>People</th></tr></thead><tbody><tr><th>KPI</th><td>KPI-1: Number of use case-driven revision of DSW Knowledge Model @ DSW</td><td>KPI-2: Number of RDMkit domain page</td><td>KPI-3: Number of RDMkit tools assembly page</td><td>KPI-4: Number of analysis of the training gaps</td></tr><tr><th>Target</th><td>All use-cases (6)</td><td>All use-cases (6)</td><td>Specific contributions (at least 2)</td><td>All use-cases (6)</td></tr></tbody></table>

## 4.2 Assessment of the adoption by community of users

ELIXIR-CONVERGE's WP5 aimed at facilitating the development of DMPs for new projects in the domains of application addressed through WP5's use cases. Testing the usefulness of the resources developed in such new projects necessitates in first place their dissemination in communities of potential users, to stimulate possible use and adoption.

ELIXIR Communities are instruments set up by ELIXIR to ensure a liaison with specialised communities of researchers in order to tailor ELIXIR's services towards the needs of these communities of users[1]. ELIXIR-CONVERGE's use cases were mapped to the ELIXIR communities (Table 2): the only use case that could not be "homed" in an ELIXIR community was the use case 2 "FAIR Epitranscriptomics". The partners involved in other use cases were encouraged to engage with the relevant ELIXIR community as a way to disseminate, test and possibly sustain on the long term the work achieved. This was achieved mainly in the context of the use cases 1 and 4 by presenting the resources developed in community's meetings or other projects. Engagement was also worked out by engaging members of the ELIXIR communities or of other relevant projects in WP5's activities, in particular in the context of the use case 1.

<table><caption>**Table 2.** Mapping of the use cases developed in ELIXIR-CONVERGE with the ELIXIR communities.</caption><thead><tr><th>Use Case</th><th>ELIXIR Community</th></tr></thead><tbody><tr><td>Harmonised FAIR plant genotype & phenotype data management toolkit for Europe</td><td>Plant Science</td></tr><tr><td>Reproducible, comparable and FAIR Epitranscriptomics</td><td></td></tr></tbody></table>

<figure><img src="image_7.png" /></figure>

<footnote n="7">⁷ https://elixir-europe.org/communities</footnote>
<table><tr><td>Common Data Management Plans for the Marine Metagenomics Community</td><td>Marine Metagenomics</td></tr><tr><td>Federated access to human genomics data: GDPR</td><td>Federated Human Data, Rare diseases</td></tr><tr><td>FAIR encoding and access to Toxicology data</td><td>Toxicology</td></tr><tr><td>FAIR organisation of biomolecular simulation information</td><td>3D-Bioinfo</td></tr></table>

Finally, a critical analysis of the work achieved in the context of two use cases was presented to WP1 monthly meetings, which involves as partners some of the data stewards of ELIXIR's national nodes, as well as to national and international communities of users and to stakeholders in the context of data management in life sciences.

Quantitative indicators of the dissemination efforts targeted to specific communities can be collected, **I-5**: number of oral presentations and posters delivered. KPI-5 does not capture the involvement in co-development of the resources. We did not define a target to reach for this indicator.

Quantitative indicators showing use and adoption are more difficult to collect at such a short time after the delivery of the resources. It was therefore proposed to list a first set of success stories in terms of adoption of these resources as a first measure of the impact of the work achieved. In addition, such stories might be re-used to improve communication on the outputs of the project.

## 5. Results

The results in terms of development of resources supporting data management planning in specific domains of application as well as in terms of adoption by users and by other important stakeholders for their sustainability are described in the sections below. Following progress with the two chosen sets of KPIs allows us to analyse the successes, opportunities and remaining challenges to be met in the development as well as in the adoption phase.

### 4.1 Monitoring the progress in the development of CONVERGE's resources in the context of the use cases

The first assessment of the progress in the development of resources supporting data management planning in the context of the 6 use cases was made at mid-term of the project (Table 3). All the use cases but one had developed a domain page in the RDMkit, giving specific guidance on data management and cross linking with supporting tools, data standards, ontologies and training resources (KPI-2). Three use cases were able to develop a

<figure><img src="image_8.png" /></figure>
tool assembly (KPI-3) and the Data Stewardship Wizard knowledge model was reviewed for all the use cases (KPI-1) resulting in a new and improved version.

The conclusion of this first phase is that the method set up to develop specific resources in the RDMkit portal in ELIXIR-CONVERGE was efficient provided that a suitable community of experts is available to spend a few days together to gather the knowledge available and to write the pages.

<table><caption>**Table 3.** Assessment of the project's progress at mid-term and end.</caption><thead><tr><th>Category of resource</th><th>DMP templates</th><th colspan="2">Digital Resources</th><th>People</th></tr></thead><tbody><tr><th>KPI</th><td>KPI-1: Number of use case-driven revision of DSW Knowledge Model @ DSW</td><th>KPI-2: Number of RDMkit domain page</th><th>KPI-3: Number of RDMkit tools assembly page</th><th>KPI4: Number of analysis of the training gaps</th></tr><tr><th>Mid-project</th><td>3</td><td>5</td><td>3</td><td>0</td></tr><tr><th>End of the project</th><td>6</td><td>6</td><td>4</td><td>6</td></tr></tbody></table>

Building on this first experience, we focussed on identifying the experts and the support necessary to develop the missing pages and soon after, the last domain page and a supplementary tool assembly was released in the RDMkit (Table 3). The work was completed by some use cases with dedicated DSW resources: a new knowledge model dedicated to the management of sensitive human health data and three project templates<fnref n="8" />[1]. This additional work is however not captured in KPI-1.

In parallel, we had a high-level analysis of training gaps in relation with data management planning in the context of all use cases through a survey followed by a series of F2F interviews for all use cases (KPI-4). This work was completed for two of them with the development of a learning path that resulted in a better structuration and detail of these.

<figure><img src="image_9.png" /></figure>

<footnote n="8">⁸ Capella-Gutierrez S, Popleteeva M, Bianchini F, Åberg E, Hooft R, Schuánek M, Slifka J, Hospital A, Willassen NP, Piñero J, Sanz F, Ramirez-Anguita JM, Pastor M, Mayer MA, Picardi E, Alper P, Ded V, Djenaba Barry N, Lieby P, d'Altri T, Faria D, Le Floch E, Rocca-Serra P, Droesbeke B, Bösl K, Vidak M (2023) Deliverable D5.5 Report on the remaining four DMP processes</footnote>
## 4.2 Engagement of communities and success stories

### 4.2.1 - Assessment of dissemination efforts in the context of the use cases

Nine oral communications and one poster were delivered to different public (ELIXIR Communities, data stewards involved in WP1, other projects) mainly in the context of use case 1 and 4 (I-5 = 10).

This indicator does not capture the fact that for instance, members of the ELIXIR Plant Science community as well as of international projects in the domain<fnref n="9" />[¹] were invited to contribute to the development of the RDMkit plant science domain pages and to the identification of training gaps in the context of this use case. As well, it does not capture the fact that the Marine metagenomics RDMkit domain pages were fully co-developed with the ELIXIR Marine metagenomic community.

### 4.2.2 - Success stories showing interest and adoption by communities of users

Finally, ELIXIR-CONVERGE WP5 started to collect success stories issued from its outputs that are listed below.

**Use case 1. Harmonised FAIR plant genotype & phenotype data management toolkit for Europe**

* The Plant Science domain pages<fnref n="10" /> and its associated Tool Assembly pages<fnref n="11" />, <fnref n="12" /> have been co-developed and regularly revised with the active contribution of the ELIXIR Plant Science community, which is a good signal for their long term maintenance. This contribution also enriched the RDMkit domain pages with a FAIR Cookbook recipe for the submission of plant sequences to ENA. Indeed, the RDMkit domain pages and the RDMkit portal as a whole constitute a one stop portal that can replace several web sites previously maintained by the members of the community to give guidance on data management.

* The plant science domain pages guidance is currently used in the french node to plan the data management in a large national project aiming at characterising large collections of genetic resources.

* The network of INRAE data stewards has adopted the learning path on Plant phenotyping data management as a frame to improve its training resources and plan to work on it in 2023.

<figure><img src="image_10.png" /></figure>

<footnote n="9">⁹ COST Action 1711 Integrape and H2020 AGENT project</footnote>

<footnote n="10">¹⁰ https://rdmkit.elixir-europe.org/plant_sciences</footnote>

<footnote n="11">¹¹ https://rdmkit.elixir-europe.org/plant_genomics_assembly</footnote>

<footnote n="12">¹² https://rdmkit.elixir-europe.org/plant_phenomics_assembly</footnote>
## Use Case 4 - Federated access to human genomics data: GDPR

* Data Protection Impact Assessment (DPIA) knowledge model (KM) has been developed by Nene Barry (LU), Pinar Alper (LU), Vilem Ded (LU), Paulette Lieby (FR) revised by ELIXIR-LU data stewards during test run and is regularly updated based on user comments. This way of preparing DPIA documents allows granular questions which are easier to understand, detailed guidance and higher independence of researchers.

* DPIA KM in DSW is currently in use at Luxembourg Centre for Systems Biomedicine (LCSB) for preparation of this document on projects involving sensitive human data.

* LCSB data stewards see significant decrease of DPIA workload as involvement of DPIA KM in DSW requires less guidance to researchers.

## Use Case 6 - FAIR organisation of biomolecular simulation information

* The creation of the RDMkit domain page on "biomolecular simulation data"<fnref n="13" /> [4] was presented to the ELIXIR structural community (3D-BioInfo) and played a role in convincing them to establish a new domain of work called "Structural bioinformatics."

* Recognition and use of the RDMkit domain page within the structural community indicates its value and impact on the field of biomolecular simulation data:

* The information presented on the RDMkit page has been incorporated into two European projects, BioExcel and MDDB, both of which are focused on simulations in biomolecular research.

* The partners involved in the BioExcel and MDDB projects have acknowledged the importance of the RDMkit page and have committed to reviewing and updating its content during the execution of these projects.

# 6. Conclusions

The KPIs developed and collected by WP5 during the ELIXIR-CONVERGE project were useful to follow the partner progresses in the development and test of a sort of starter kit for domain specific data management support that includes:

* RDMkit domain pages and tool assembly

<figure><img src="image_11.png" /></figure>

<footnote n="13">¹³ https://rdmkit.elixir-europe.org/biomolecular_simulation_data</footnote>
* DSW knowledge model improvements and project templates

* Learning path template

Success stories could be collected in addition, showing adoption by communities and new projects. These success stories are a first assessment of the impact of WP5, as described in the next chapter.

## 7. Impact

The success stories already collected can be mapped in the different categories of impact that have been developed by WP4 in the framework of ELIXIR-CONVERGE as well as joined activities with other projects<fnref n="14" />,<fnref n="15" /> as described in table 4. They map on 5/9 of these categories, which is very encouraging in terms of usefulness of the resources developed and of engagement to maintain them beyond the project.

<table><caption>**Table 4.** Mapping of the success stories collected in the context of the work achieved on use cases in ELIXIR-CONVERGE on ELIXIR's impact categories<fnref n="15" /></caption><thead><tr><td>Impact category - Title</td><td>Impact category - Description</td><td>ELIXIR-CONVERGE success story</td></tr></thead><tbody><tr><td>Research efficiency</td><td>We make infrastructure, bioinformatics resources and processes faster, easier to use, and more integrated</td><td>Adoption of the RDMkit domain pages by new projects in the context of the Plant Science and 3D-Bioinfo communities; adoption of the DPIA-KM by researchers</td></tr><tr><td>Scientific legacy</td><td>(i.e. research dissemination) We increase awareness of developments related to research infrastructure, bioinformatics resources and related guidelines</td><td>Publication of 6 RDMkit domain pages</td></tr></tbody></table>

<figure><img src="image_12.png" /></figure>

<footnote n="14">¹⁴ Martin, CS, Repo, S, Arenas Márquez, J, et al. Demonstrating public value to funders and other stakeholders—the journey of ELIXIR, a virtual and distributed research infrastructure for life science data. *Ann Public Coop Econ.* 2021; 92: 497–510. https://doi.org/10.1111/apce.12328</footnote>

<footnote n="15">¹⁵ https://elixir-europe.org/about-us/impact/more-examples</footnote>
<table><tr><td>Benefits of working together</td><td>(i.e. relationship capital) We facilitate knowledge-sharing and cooperation</td><td>Joint activities with projects consortia and ELIXIR communities to maintain and improve DMP guidance in the context of Plant Science and 3D Bioinfo</td></tr><tr><td>Public awareness</td><td>We raise public awareness of bioinformatics and open science, including their socio-economic and societal benefits</td><td>-N/A</td></tr><tr><td>Policy influence</td><td>We ensure that policy-makers are aware of the benefits of Open (FAIR) Science</td><td>-N/A</td></tr><tr><td>Equal opportunity</td><td>We raise awareness of diversity and inclusiveness</td><td>-N/A</td></tr><tr><td>Skills development</td><td>(i.e. human capital) We foster better skills for users and service providers</td><td>Adoption of the learning path by the INRAE network of data steward to improve their training resources</td></tr><tr><td>Research infrastructure sustainability</td><td>We work to increase ELIXIR's visibility with, and appreciation by, funders.</td><td>-N/A</td></tr><tr><td>Bioinformatics resource uptake</td><td>We work to increase their usage and appreciation by users</td><td>Reduction of the workload of ELIXIR-LU's data stewards showing an easy uptake of the DPIA-KM by researchers.</td></tr></table>

## 8. Next Steps

Beyond the ELIXIR Project, ELIXIR partners will continue to develop support to DMP by mobilising the domain DMP support starter kit and to improve the resources already developed but the first set of KPIs will not be collected anymore. Communication on these activities will be crucial to continue engaging relevant experts for the improvement of the ecosystem and knowledge hub that is emerging and for its long term sustainability.

<figure><img src="image_13.png" /></figure>
We expect new success stories showing adoption and higher efficiency in data management planning and possibly also mapping to new categories of impact such as Research Infrastructure sustainability and policy maker awareness.

## 9. Deviation from Description of Action

NA

<figure><img src="image_14.png" /></figure>