D12.4 – Final report on data integration
Creators: name: Bardi, Alessia
name: Fihn Marberg, Johan
name: Theodoridou, Maria
Publisher: name: Zenodo
Year: 2022
Subjects: Data integration
GraphDB
OpenSearch

description: This deliverable describes the final results of Tasks 12.1, 12.2, 12.3 and 12.4 of the ARIADNEplus project. The tasks developed, delivered, and maintained the components of the ARIADNEplus infrastructure that support the integration and interoperability of the data provided by the members of the consortium and associate partners. The catalogue data integrated by the ADI (the Aggregative Data Infrastructure developed in T12.2) are transformed into RDF records compliant with the CRM-based ARIADNEplus Ontology (AO-Cat) and are made publicly available in the ARIADNEplus Knowledge Base (T12.1), where they are enriched and linked to the Getty AAT thesaurus and the PeriodO gazetteer of time periods. The knowledge base exposes a SPARQL endpoint and its content is indexed on an OpenSearch index that serves the ARIADNEplus portal (T12.3). The domains of mortuary archaeology, numismatics and epigraphies were chosen for deeper integration of item level data (T12.4) compliant with specific Application Profiles developed in WP4. A searching interface, built on the ResearchSpace platform provides support for research questions that require information richer than what is available in AO-Cat. The design, development and deployment activities have been guided by the requirements of all the members of the consortium, especially those involved in WP4, WP5 and the working group on portal requirements. The ARIADNEplus ADI features the following main components for data collection, transformation, and harmonisation: (i) the 3M Editor developed and maintained by FORTH, operated by CNR; (ii) the Vocabulary Matching Tool developed and maintained by USW, operated by CNR; and (iii) the ARIADNEplus aggregator developed, maintained, and operated by CNR. The knowledge base is implemented with GraphDB (free edition) and one Springboot application that acts as mediator for the interactions among the aggregator, GraphDB, and OpenSearch. As of October 2022, the KB contains 175M RDF triples describing 3M resources from 60K collections and 25 providers. Numbers are expected to increase by December 2022 with the aggregation of additional resources as planned in WP5. OpenSearch provides a full-text index of the content available in the knowledge base, to be used by the ARIADNEplus portal. The ARIADNEplus portal is developed using PHP, Vue.js, Javascript, Vuex, Tailwind, and Font Awesome. The portal provides standard free-text and faceted search options, but also advanced features based on the concepts of temporal, spatial, and topical coverage. In order to test the new functionality of the portal and enable data curators to check the quality of data before it is made available on the public portal, WP12 set up a staging environment accessible only to members of the consortium, where the collected data is aggregated, added to a staging knowledge base and indexed on a staging portal. Upon confirmation of data experts, data is then pushed to the production environment.
description: {"references": ["Bardi Alessia, Marberg Johan Fihn, &amp; Theodoridou Maria. (2021). D12.2 \u2013 Mid-term report on data integration. Zenodo. https://doi.org/10.5281/zenodo.4922902", "Assante Massimiliano, Cirillo Roberto, Dell'Amico Andrea, &amp; Pagano Pasquale. (2021). D13.2 \u2013 VREs Operation Mid-term Activity Report. Zenodo. https://doi.org/10.5281/zenodo.4926516", "FAIRsharing.org: PAV; Provenance, Authoring and Versioning Ontology DOI: 10.25504/FAIRsharing.nbfwwv", "Ciccarese, P., Soiland-Reyes, S., Belhajjame, K. et al. PAV ontology: provenance, authoring and versioning. J Biomed Semant 4, 37 (2013). https://doi.org/10.1186/2041-1480-4-37", "FAIRsharing.org: PROV-O; W3C Provenance Ontology DOI: 10.25504/FAIRsharing.2rm2b3", "Manghi, P., Artini, M., Atzori, C., Bardi, A., Mannocci, A., La Bruzzo, S., Candela, L., Castelli, D. and Pagano, P. (2014), \"The D-NET software toolkit: A framework for the realization, maintenance, and operation of aggregative infrastructures\", Program: electronic library and information systems, Vol. 48 No. 4, pp. 322-354. https://doi.org/10.1108/PROG-08-2013- 0045", "Bardi. (2022). ARIADNEplus questionnaire responses for metadata aggregation (1.0) [Data set]. Zenodo. https://doi.org/10.5281/zenodo.7221186", "Survey of Numismatic Research 2014\u20132020, International Numismatic Congress https://www.inc-cin.org/assets/pdf/survey/Survey%202014-2020.pdf", "Edeltraud Asp\u00f6ck, Maria Theodoridou, &amp; Achille Felicetti. (2022). Types of burial data and proposal of a Mortuary Data Application Profile for ARIADNEplus (WP4.4.14) (1.1). Zenodo. https://doi.org/10.5281/zenodo.7243782"]}