# HTR-United schema for dataset description

Alix Chagué

► To cite this version:

Alix Chagué. HTR-United schema for dataset description. 2025 Workshop SCOOP - Source Codes of the Past, Institute of Advanced Study (IAS), Princeton; Center for Digital Humanities (CDH), Princeton; Manuscripts, Rare Books, and Archival Studies (MARBAS), Princeton; Humanities Initiative, Princeton; Digital Lab, Institute for Medieval Research (IMAFO), Vienna, Jun 2025, Princeton NJ, United States. hal-05117083

HAL Id: hal-05117083

https://inria.hal.science/hal-05117083v1

Submitted on 17 Jun 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
HTR-United

schema for
dataset description

Alix
Chagué*

SCOOP: Source Codes of the Past

Institute for Advanced Study, Princeton, June 12-13, 2025

*Université de Montréal, Canada / ALMAnaCH, Inria, France
<figure><img src="image_2.png" /></figure>

<figure><img src="image_3.png" /></figure>

<figure><img src="image_4.png" /></figure>

20,601 result(s) found

Versions

<figure><img src="image_5.png" /></figure>

View all versions

May 20, 2022 (0.9)

Dataset

Open

Ground-Truthed Data Set of Zenon Papyri for Handwritten Text Recognition

Marthot-Santaniello Isabelle Ⓟ: Hodel Tobias Ⓟ

Access status

Clear

<figure><img src="image_6.png" /></figure>

Open

143,825

<figure><img src="image_7.png" /></figure>

Restricted

7,970

<figure><img src="image_8.png" /></figure>

Embargoed

397

Resource types

Clear

<figure><img src="image_9.png" /></figure>

Publication

107,922

<figure><img src="image_10.png" /></figure>

Dataset

19,357

<figure><img src="image_11.png" /></figure>

Image

13,871

<figure><img src="image_12.png" /></figure>

Software

3,764

<figure><img src="image_13.png" /></figure>

Other

2,340

<figure><img src="image_14.png" /></figure>

Presentation

2,285

<figure><img src="image_15.png" /></figure>

Poster

1,464

<figure><img src="image_16.png" /></figure>

Video/Audio

539

<figure><img src="image_17.png" /></figure>

Lesson

294

<figure><img src="image_18.png" /></figure>

Model

196

Sort by

Best match

<figure><img src="image_19.png" /></figure>

Diplomatic transcription of papyri found in the Zenon archive [see en.wikipedia.org/wiki/Zenon_of_Kaunos] Manually prepared as PageXML with Transkribus within D-Scribes project.

Uploaded on May 20, 2022

<figure><img src="image_20.png" /></figure>

461

<figure><img src="image_21.png" /></figure>

1174

January 2, 2024 (v.1.1)

Dataset

Open

ERC-TibSchol/Tibetan-Cursive-GT: v.1.1

Griffiths, Rachael

Initial release of GT dataset and metadata on Zenodo. The repository contains the Ground Truth (GT) for Handwritten Text Recognition (HTR) models to recognize the handwritten Tibetan scripts Drutsa ('bru tsha) and Betsug (dpe tshugs). The Ground Truth was prepared in the framework of the ERC project "The Dawn of Tibetan Buddhist Scholasticism (11th-13th c.)" (TibSchol). Cf. https://www.oew.ac.at/projec...

Uploaded on January 2, 2024

<figure><img src="image_22.png" /></figure>

124

<figure><img src="image_23.png" /></figure>

8

May 10, 2021 (1)

Dataset

Open

TIMEUS_CPH011878 - Ground Truth for French end-of-19th-century HTR

Alix Chagué Ⓟ: Analès Albert; Kévin Champougny

Transcriptions des comptes-rendus d'audience du Conseil des Prud'hommes pour l'industrie du Textile, pour le mois de janvier 1878, réalisées dans le cadre du projet ANR TIME US. Côte originale : AD75 D1U10 405.

Uploaded on May 10, 2021

<figure><img src="image_24.png" /></figure>

181

<figure><img src="image_25.png" /></figure>

9

August 2, 2021 (1.0)

Dataset

Open

Handwritten Text Recognition Ground Truth Set: StABS Ratsbücher O10, Urfehdenbuch X

Hodel, Tobias Ⓟ; Schoch, David Ⓟ; Dängeli, Peter Ⓟ

Ground Truth for "Urfehdenbuch X der Stadt Basel (1563-1569)" at Staatsarchiv Basel-Stadt (StABS). Images and text aligned, using text-to-image (provided within Transkribus, www.readcoop.eu). ALTO and Page XML are available for the text alignment. TEI to txt on page basis by Peter Dängeli. Derived from Transcription/TEI file: Urfehdenbuch X der Stadt Basel (1563-1569), in: Die Urfehdebücher der Stadt Basel...

Uploaded on August 2, 2021

<figure><img src="image_26.png" /></figure>

771

<figure><img src="image_27.png" /></figure>

77
# Required Fields

## schema

☐ closed text

## title

☐ free text

## url

☐ URI

## description

☐ free text

## script

☐ closed list (ISO-15924)

## qualify

☐ free text

## language

☐ closed list (ISO-639)

## time

## notBefore

☐ YYYY-MM-DD

## notAfter

☐ YYYY-MM-DD

## volume

## count

☐ integer

## metric

☐ closed list (cust.)

## licence

## name

☐ free text

## url

☐ URI

## production-software

☐ free text
# Optional Fields

## citation-file-link

☐ URI

## authors

### name

☐ free text

### surname

☐ integer

### orcid

☐ controlled text

### roles

☐ closed list (cust.)

## project-name

☐ free text

## project-website

☐ URI

## transcription-guidelines

☐ free text

## automatically-aligned

☐ boolean

## institution

### name

☐ free text

### roles

☐ closed list (cust.)

## characters

### mode

☐ closed list (cust.)

### transliteration

☐ boolean

### members

☐ free text

## sources

### reference

☐ free text

### link

☐ URI

### description

☐ free text
# Optional Fields

## citation-file-link

☐ URI

## authors

### name

☐ free text

### surname

☐ integer

### orcid

☐ controlled text

### roles

☐ closed list (cust.)

## project-name

☐ free text

## project-website

☐ URI

## transcription-guidelines

☐ free text

## automatically-aligned

☐ boolean

## institution

### name

☐ free text

### roles

☐ closed list (cust.)

## characters

### mode

☐ closed list (cust.)

### transliteration

☐ boolean

### members

☐ free text

## sources

### reference

☐ free text

### link

☐ URI

### description

☐ free text
# Transcription Guidelines and Free Text

* "transcription-guidelines" can be important to filter datasets

* But the values in this field are too diverse

* How can we better structure this field?

See: https://www.koenigsfelden.uzh.ch/exist/anns/citation/1101101

nien

Transcription guidelines

Transcription guidelines

Ariane Pinche. Guide de transcription pour les manuscrits du Xe au XVe siècle.

Transcription guidelines

Regions and baselines are distinguished by types, mainly to differentiate
between main text from commentaries. Diplomatic transcription with the
following exceptions: characters are transcribed in their standard form based on
the online dictionary of variants (https://dict.variants.org/)

Transcription guidelines

See the g

Kept abbreviation and transcribed long s as long s

General Model for Medieval Hebrew Manuscripts and an Open Annotated
Dataset. In The 6th International Workshop on Historical Document Imaging and
Processing (HIP '21). Association for Computing Machinery, New York, NY, USA,
61-66. DOI:https://doi.org/10.1145/3476887.3476896'

Transcription guidelines

In general this meant deciding between diplomatic transcription (i.e. sticking to what it says on the page) and gently modernized features (i.e. reinterpreting medieval signs into modern equivalents) with a view to specific categories. Read on for a summary of the rules and the respective rationale behind them.

**SUMMARY PUNCTUATION**

Modern: medieval punctuation is transcribed with modern equivalent

Diplomatic trans
of its original fea

• orthography

• abbreviations

• capitalization

• punctuation
they are un

• special characters

• formatting;
• strikethrough

• errors and

• non-interpretation

• use the '@' symbol
on baseline level

• tag marginal
region level

CAPITALIZATION

Diplomatic: Original capitalization retained

ABBREVIATIONS

Diplomatic where possible: Retain abbreviations and render glyphs
""" where original character isn't served: OCRopus (at the point :

SPACING

Diplomatic: Preserve manuscript spacing, i.e. give diplomatic tra

NUMBERS

Diplomatic: retain original version of both Roman and Arabic num

Automated transcript alignment with Transkribus

Transcription guidelines
# CREMMA

* Infrastructure project for (French) eScriptorium instance

* Modular configuration with strong computation power

* Multi-institution partnership, maintained by Inria

* Currently 780 registered users

* Free sign up request through form

* In exchange for publication of GT datasets

<figure><img src="image_28.png" /></figure>

## More on the infrastructure

Cremma

Alix Chagué, Thibault Clérice. 017 - Deploying eScriptorium online: notes on CREMMA's server specifications. 2023. (hal-04362085)

<figure><img src="image_29.png" /></figure>
# Transcription Guidelines Hints in CREMMA

## Do you solve abbreviations?

* Yes, without markers (dominus)

* Yes, with marker (domin<us>)

* No (domin)

## Do you correct spelling errors?

* Yes

* No

## Does your transcription convey sign variations?

* Yes

* No

## Do you modernize spelling?

* Yes

* Latin Script: only U/V and I/J

* Correcting capitalization

* Normalizing ponctuation

* Normalizing Space

* No
THANK
YOU!

<figure><img src="image_30.png" /></figure>