MobiDataLab D4.4 Reference Data Catalogue (V2)
Creators: name: OBREGON-GONZALEZ, Renée
name: CHEVALLIER, Thierry
name: DJELOUAT, Maroua-Dorsaf
name: KARAMI, Mohamed
name: LAUER, Johannes
name: NGUYEN, Huy Minh
name: SIGHOKO, Sorel
Publisher: name: Zenodo
Year: 2023
Subjects: CKAN
GeoNetwork
metadata catalogue
FileStore
API
DataStore
DataPusher
Geospatial search
harvesting
multi-lingual management
translation
Scraping
Python
interoperability
web interface
cybersecurity
virtual lab
living lab
datathon
hackathon
cloud services

description: The reference data catalogue (task 4.2) is part of the Transport Cloud (i.e., a federation of cloudservices) demonstrators. This task aims to improve the findability of open data catalogue referencingtransport datasets (using common catalogue software systems) and corresponding metadata (in theterritorial context and specific domains) of the “Reference Group” of the MobiDataLab stakeholdersand to provide a state-of-the-art. In this delivery, it is going to be demonstrated how the goals of thetask were achieved by:• cataloguing transport data in the local context of the project stakeholders (that can be reused bymobility digital services like journey planners)• cataloguing the use case data that can be used to enrich stakeholder transport datasets• providing human-readable and machine-readable metadata available in multiple formats:o metadata can be discovered in the MobiDataLab CKAN and GeoNetwork catalogues via aplatform and the catalogue’s API,• reusing existing standards and popular vocabularies (i.e., DCAT, DCAT-AP and CSW),• providing explicit dataset metadata (title, description, keywords, publication date, source,publisher, data format, spatial coverage, etc.) allowing both human understanding and automaticdiscovery by software agents,• providing structural information about the internal structure of the datasets (e.g., JSON-LD, XMLschema, etc.), making possible to interpret manually/automatically data schemas.This deliverable recalls the reasoning behind the choices regarding the cataloguing solutions, theirportability and the relevance of combining them. This document will cover their implementationevolution in relation to the virtual and living labs proposed by MobiDataLab.In this version, it was shown how to discover, manage, visualize, harvest and translate metadata inthe chosen data catalogues.Furthermore, to improve the findability of datasets we provided improvements to the existent CKANfunctionalities by translating all the metadata of datasets, adding a tag filter into the harvester andcorrecting the bugs of Solr. In this delivery, a scrapping method was also covered as a temporarysolution for obtaining open data which is published on websites which are not yet fully interoperable.This deliverable is a report whose main components are two video demonstrations of theMobiDataLab catalogues. This video is accessible on the following MobiDataLab GitHub repository:Reference Data Catalogue demo v2The contributions made are also available on the following links:• Addition of tags filters and fix multivalue query syntax• Code implementation of the translation added on the harvester (new optional argument andsupport for dataset auto translation for DCAT and CSW inspire• Reported issues