# Dataverse, an open and collaborative source research data repository software

Baptiste Rouxel, Alina Danciu, Jim Meyers, Geneviève Michaud, Tom Villette

► To cite this version:

Baptiste Rouxel, Alina Danciu, Jim Meyers, Geneviève Michaud, Tom Villette. Dataverse, an open and collaborative source research data repository software. 13th European DDI User Conference 2021, Training FAIR, EDDI, Nov 2021, Virtuel, France. pp.13. hal-03891601

HAL Id: hal-03891601

https://sciencespo.hal.science/hal-03891601

Submitted on 9 Dec 2022

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Dataverse, an open and collaborative
source research data repository
software

Alina Danciu¹, Geneviève Michaud¹, Jim Myers², Baptiste Rouxel¹, Tom Villette¹

¹Center for Socio-Political Data (CDSP)

²Global Dataverse Community Consortium (GDCC)
"Dataverse is an open source software platform for sharing, finding, citing, and preserving research data (developed by the Data Science and Products team at the Institute for Quantitative Social Science and the Dataverse community)."

Source: https://github.com/IQSS/dataverse
# What?

## 75 installations worldwide

Software installation, which then hosts multiple virtual archives called Dataverse collections. Each Dataverse collection contains datasets, and each dataset contains descriptive metadata and data files (including documentation and code that accompany the data). As an organizing method, Dataverse collections may also contain other Dataverse collections.
# Why?

## Dataverse is a good solution for networked institutions

- Single Sign On using institutional credentials

- Can harvest and be harvested

- General and Dataverse-level branding capabilities

## Dataverse supports discoverability and persistence

- Powerful search engine and filters

- Good Google referencing

- Persistent identifiers
## What for?

- Nesstar => Dataverse

- Harmonising metadata (institution names - in-house + ROR and

- ISNI, authors, keywords -ELSST...)

- Implementing DDI controlled vocabularies
Classification des sujets 🔍

# How?

In-house development of several scripts, some using Dataverse APIs:

- metadata harmonisation & conformity to CESSDA Metadata Model (CMM)

- migrating metadata from Nesstar to Dataverse

Installation and configuration of a Dataverse instance enabling:

- controlled vocabularies (according to the CMM, DDI CVs)

- multilingual UI (including CVs translation)

- OAI-PMH harvesting

Terme 🔍

Santé au travail

Services et politiques de soins

Médicaments et traitements

Santé au travail

Condition et activité physique

Santé publique

Santé reproductive

Signes et symptômes ; conditions pathologiques

Vocabulaire 🔍

<figure><img src="image_2.png" /></figure>

<figure><img src="image_3.png" /></figure>

<figure><img src="image_4.png" /></figure>
data.sciencespo repository

CDSP data bank & institutional self deposit
repository released January 2020:

- 7 custom CVs

- 300+ metadata items harmonised & migrated

- EN | FR user interface

- including CVs translations

- custom homepage and style

- harvested by:

- CESSDA DATA Catalogue (select French UI)

- french SSH portal Isidore

- European OpenAIRE portal

<figure><img src="image_5.png" /></figure>
# Dataverse communities

- Other groups working on similar issues (PyDataverse, SuperDADA etc)

- CDSP's contributions to IQSS DV codebase (pull requests)

- Opening of several issues aimed at OAI-PMH endpoints

- harvesting by the CESSDA Data Catalogue

- Decision to sponsor a list of key issues (GDCC contract and collaboration)

- tackling **concerns shared among users in the DDI community**
<figure><img src="image_6.png" /></figure>
# Internationalization in Dataverse

## Viewing in multiple languages

* User Interface translations

* Translations of metadata fields with controlled vocabularies

## Issues raised by Sciences Po re: Content Creation/Machine Harvesting:

* Metadata field to specify the language(s) used in data files, but

* No way to indicate the language used to enter metadata for a dataset

* Metadata exports (including the DDI export used for harvesting by CESSDA) do not indicate the language used

<figure><img src="image_7.png" /></figure>
# Specifying the Metadata Language

Admins enable/specify the allowed languages

Sub-collections are configured to indicate the metadata language allowed for new datasets

Dataset creators/editors are prompted to use the configured language

<figure><img src="image_8.png" /></figure>
# Exporting Language Information

Metadata exports include metadata language, i.e. DDI:

## Overall xml:lang attribute

```xml
<codeBook xmlns="ddi:codebook:2_5"
           xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
           xsi:schemaLocation="ddi:codebook:2_5
https://ddialliance.org/Specification/DDI-Codebook/2.5/XMLSchema/codebook.xsd"
           version="2.5" xml:lang="fr">
```

## Individual xml:lang attributes on specific fields

```xml
<abstract xml:lang="fr">TEST</abstract>
```

## Controlled values exported in site default language and dataset's metadata language

```xml
<sumDscr>
<anlyUnit xml:lang="en">Family: Household family</anlyUnit>
<anlyUnit xml:lang="en">Household</anlyUnit>
<anlyUnit xml:lang="fr">Famille : ménage</anlyUnit>
<anlyUnit xml:lang="fr">Ménage</anlyUnit>
</sumDscr>
```

<footnote>* Thanks for the [online CESSDA validator!](https://cessda.eu/) - used to identify where language information was needed/recommended</footnote>
Community Processes

The
Dataverse®

<figure><img src="image_9.png" /></figure>

Project

Open Source on GitHub

Community-contributed issues and code contributions

Community contributions to language translations

<figure><img src="image_10.png" /></figure>

GDCC - Global Dataverse Community Consortium

Prioritizing work of interest across the community

Contracting to enable members to engage experienced developers/admins on their priorities