DOI: 10.5281/zenodo.10822097
title: DGS-Fabeln-1

description: # DGS-Fabeln-1

 

## General Info

 

This is a corpus between written German and German Sign Language (DGS).

It consists of 7 fairy tales recorded from 7 points of view, plus 1 for the backchanneling (framing the listener).

 

The 7 fairy tales are:

 

1. Der Hase und der Igel

2. Frau Holle

3. Der Wolf und die 7 Geißlein

4. Schneewittchen

5. Hänsel und Gretel

6. Dornröschen

7. Die Bremer Stadtmusikanten

 

See the XLS file in this repository (`DGS-Fabeln-1-Content-yymmdd.xlsx`) for details about code number, short name, and some stats.

E.g., the first fairy tale numer/code is `1-DHUDI`.

 

 

## References

 

This corpus is associated to the paper presented at the 2024 LREC conference. Cite as:

 

Nunnari, F., Avramidis, E., España-Bonet, C., González, M., Hennes, A., & Gebhard, P. (2024). DGS-Fabeln-1: A Multi-Angle Parallel Corpus of Fairy Tales between German Sign Language and German Text. In N. Calzolari, M.-Y. Kan, V. Hoste, A. Lenci, S. Sakti, & N. Xue (Eds.), Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) (pp. 4847–4857). ELRA and ICCL. https://aclanthology.org/2024.lrec-main.434

 

Bibtex:

 

```

@inproceedings{nunnari-etal-2024-dgs-fabeln,

    title = "{DGS}-Fabeln-1: A Multi-Angle Parallel Corpus of Fairy Tales between {G}erman {S}ign {L}anguage and {G}erman Text",

    author = "Nunnari, Fabrizio  and

      Avramidis, Eleftherios  and

      Espa{\~n}a-Bonet, Cristina  and

      Gonz{\'a}lez, Marco  and

      Hennes, Anna  and

      Gebhard, Patrick",

    editor = "Calzolari, Nicoletta  and

      Kan, Min-Yen  and

      Hoste, Veronique  and

      Lenci, Alessandro  and

      Sakti, Sakriani  and

      Xue, Nianwen",

    booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",

    month = may,

    year = "2024",

    address = "Torino, Italy",

    publisher = "ELRA and ICCL",

    url = "https://aclanthology.org/2024.lrec-main.434",

    pages = "4847--4857",

    abstract = "We present the acquisition process and the data of DGS-Fabeln-1, a parallel corpus of German text and videos containing German fairy tales interpreted into the German Sign Language (DGS) by a native DGS signer. The corpus contains 573 segments of videos with a total duration of 1 hour and 32 minutes, corresponding with 1428 written sentences. It is the first corpus of semi-naturally expressed DGS that has been filmed from 7 angles, and one of the few sign language (SL) corpora globally which have been filmed from more than 3 angles and where the listener has been simultaneously filmed. The corpus aims at aiding research at SL linguistics, SL machine translation and affective computing, and is freely available for research purposes at the following address: https://doi.org/10.5281/zenodo.10822097.",

}

```

 

 

## Structure

 

Each fairy tale is composed by: sentence list (CSV file), videos (a zipped folder), annotations (a zipped folder):

 

 

### Sentence List

 

A single comma-separated-values (CSV) file with very simple 2-column structure.

 

Example filename: `1-DHUDI-Sentences.csv`

 

```

id,text_original

S1,Der Hase und der Igel. Es war einmal: So fangen Märchen an. Ein Märchen ist eine sehr alte Geschichte. Dieses Märchen heißt: Der Hase und der Igel. Das Märchen geht so:

...,...

```

 

### Videos

 

A zipped folder with name scheme `1-DHUDI.zip` containing, for each segment (S1, S2, ...):

 

* All videos (Front, Left/Right on 30/60/90 degrees). These videos contain black frames when the device couldn't capture the frame

* For each video also the exact timestamp, in nanoseconds, when the frame was shot. This is the result of the automatic alignment system.

* A `NiceCollage.mp4` showing all videos at once

* A `Backchannel.mp4` video, and its `Backchannel.csv` timestamps, framing the listener.

* An `FrontOriginal.mp4` video as recorded on the device. Thus NOT showing the injected black frames. More comfortable for annotation.

 

Example of the unzipped folder:

 

```

1-DHUDI/

    00-Sentences.txt

    DHUDI-S1/

        NiceCollage.mp4

        Left30.mp4

        Left30.csv

        Front.mp4

        Front.csv

        Front-Original.mp4

        Backchannel.mp4

        Backchannel.csv

        ...

```

 

 

### Annotations

 

Annotations are exported from the ELAN software.

For each tale, the annotations are zipped in a file with a name like `1-DHUDI-ELAN.zip`.

 

Content follows this structure:

 

```

1-DHUDI-ELAN/

    _Glossen-Liste.txt

    DHUDI-S1.eaf

    DHUDI-S1.pfsx

    DHUDI-S2.eaf

    DHUDI-S2.pfsx

    ...

```