# A TEI-based publication pipeline for historical egodocuments - the DAHN project

Floriane Chiffoleau, Anne Baillot, Manon Ovide

► To cite this version:

Floriane Chiffoleau, Anne Baillot, Manon Ovide. A TEI-based publication pipeline for historical egodocuments - the DAHN project. Next Gen TEI, 2021 - TEI Conference and Members' Meeting, Oct 2021, Virtual, United States. http://hal-03451421

HAL Id: hal-03451421

https://hal.science/hal-03451421

Submitted on 26 Nov 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# A TEI-based publication pipeline for historical egodocuments - the DAHN project

Floriane Chiffoleau, PhD candidate at Le Mans Université and ALMAnaCH Inria
Anne Baillot, Professor at Le Mans Université (3LAM) and Researcher at ICAR UMR 5191 at ENS de Lyon
Manon Ovide, Intern at ALMAnaCH Inria
"Next-Gen TEI"
October 25 - 30, 2021 | Virtual Conference

<figure><img src="image_2.png" /></figure>

ALMAnaCH project-team

Inria

<figure><img src="image_3.png" /></figure>

Le Mans
Université

<figure><img src="image_4.png" /></figure>

3L.AM
Langues, Littératures,
Linguistique
Le Mans Université
Université d'Angers

<figure><img src="image_5.png" /></figure>
# Presentation

1. The **DAHN project**: a pipeline for digital scholarly edition of historical documents

2. **Experimenting** with the pipeline: working with corpora

3. Obtaining digital texts: the **eScriptorium** interface

4. Completely and accurately rendering the transcription: **encoding** with TEI XML

5. The key element of our pipeline: a TEI-based **publication application**

6. Conclusion: a **minimalist pipeline** for a maximum efficacy
# The DAHN project: a pipeline for digital scholarly edition of historical documents

- Technological and scientific collaboration between Inria, Le Mans Université and EHESS

- Funded by the Ministry of Higher Education, Research and Innovation

- Work progress stored in a Github repository (DAHNProject) and documented in a Hypothèses blog (https://digitalintellectuals.hypotheses.org/category/dahn)

<figure><img src="image_6.png" /></figure>
# Experimenting with the pipeline: working with corpora

<figure><img src="image_7.png" /></figure>

Paul d'Estournelles de Constant' corpus: development of the pipeline, segmentation/transcription, creation of models, encoding scripts, early development of the TEI Publisher application

Berlin intellectuals' corpus: updating of the TEI, new encoding scripts for modification, upload to IIIF server, counterbalance for the development of the TEI Publisher application

<figure><img src="image_8.png" /></figure>

Publication phase tested by other corpora: [Time-Us](https://www時間.Us), [Lectaurep](https://lectaurep.org) (decided to develop their own instance), [EHRI](https://ehri.org), Rochlitz manuscript (future corpora on our instance)
# Obtaining digital texts: the eScriptorium interface

- eScriptorium: web interface for collaborative and automatic transcription projects, relying on the OCR software Kraken

<figure><img src="image_9.png" /></figure>

- Images import (IIIF or upload), segmentation/transcription, OCR/HTR, creation or finetune of models for segmentation/transcription, annotation of regions and lines

- Three kinds of TEI-compatible export:

- XML Page: transformation with an XSL (https://github.com/lectaurep/page2tei)

- Text: transformation with Python scripts

- Future implementation: TEI export in the interface
# Completely and accurately rendering the transcription:
encoding with TEI XML

- TEI Guidelines

- Encoding guidelines written specifically for egodocuments

- Encoding scripts

- Automatic encoding of the header with the generic information from the corpus

- Encoding of the body with regular expression, using the unique architecture of egodocuments

- Addition of few information after manual correction

- Updating of some parts of the header and/or the body

<figure><img src="image_10.png" /></figure>

<figure><img src="image_11.png" /></figure>
# The key element of our pipeline: a TEI-based publication application

- Developed with TEI Publisher, a tool for scholars and researchers, offering them the possibility to publish their work, without extended programming knowledge

<figure><img src="image_12.png" /></figure>

<figure><img src="image_13.png" /></figure>
# Conclusion: a minimalist pipeline for a maximum efficacy

- The researcher has all the tools at their disposal to exploit the full potential of their corpus

- TEI ensures consistency and sustainability

- Upcoming improvement: annotation of named entities (the perfect way to exploit a corpus even more)
Contact

Floriane Chiffoleau: [floriane.chiffoleau@inria.fr](mailto:floriane.chiffoleau@inria.fr)

Anne Baillot: [anne.baillot@univ-lemans.fr](mailto:anne.baillot@univ-lemans.fr)

Github project: [https://github.com/FloChiff/DAHNProject](https://github.com/FloChiff/DAHNProject)

Hypotheses blog: [https://digitalintellectuals.hypotheses.org/category/dahn](https://digitalintellectuals.hypotheses.org/category/dahn)