# Presentation: 529360

## docWORKS/METAe

**The Engine for Automated Metadata Extraction and XML Tagging **
**Claus Gravenhorst**
**Content Conversion Specialists**

## Production tool for conversion of printed documents into fully tagged digital objects

- What is docWORKS/METAe?

- The METAe edition of docWORKS is the result of the EU-funded project METAe
- Start of project: September 2000
- End of project: August 2003
- Product launch: March 2003, CeBIT exhibition

## CCS – Offices

- The project group

- Leopold-Franzens-Universität Innsbruck (Co-ordinator), Austria
- Universität Linz, Institut für Angewandte Informatik, University of Linz, Austria
- Mitcom Neue Medien GmbH (ABBYY Europe), Germany
- CCS Compact Computer Systeme, Germany
- Universidad de Alicante, Spain
- Friedrich-Ebert-Stiftung, Germany
- Cornell University Library. Department of Preservation and Conservation, USA
- Bibliothèque nationale de France
- The National Library of Norway, Rana division, Norway
- Biblioteca Statale A. Baldini, Italy
- Dipartimento di Sistemi e Informatica, University of Florence, Italy
- Karl-Franzens-Universität Graz, Universitätsbibliothek, Austria
- Scuola Normale Superiore, Centro di Ricerche Informatiche per i Beni Culturali, Italy
- Higher Education Digitisation Service HEDS, UK

## Digitization and retro-conversion of printed or textual material is getting more and more important:

- Challenges

- Keep knowledge and cultural heritage alive
- Preserve the origin
- Enable quick and enhanced access by high structured documents
- Open up new dimensions of research
- Provide standardized output formats

## Automate the conversion process

- Goals

- Make digitization more effective and safer
- Increase the added value of digitized    collections
- Provide a standardized output format in order    to allow transformation of metadata into    various applications and systems

## docWORKS engine

- docWORKS – System Overview

- document

- METS/ALTO
- METS/TEI
- PDF
- TIFF, JPEG

- RulesDB

- Input

- Output

## CCS – Offices

- docWORKS – recording as much metadata as possible!

|  | Available 
data | Descriptive metadata | Administra-
tive
metadata | Structural metadata - logical | Structural metadata - physical |
| --- | --- | --- | --- | --- | --- |
| 
Formats
 | 
Library 
records, e.g. 
MARC
TIFF Images | 
METS
DC or MODS
linking to
catalogue
record | 
METS 
incl.
NISO (mix)
 | 
METS 
Structural 
map 
 | 
ALTO 
(Analyzed 
Layout and 
Text Object) |
| 
docWORKS
engine | 
Import 
of subsets,
linking 
to record
 | 
Creates 
descriptive 
records 
for articles, pictures,... | 
Records 
metadata
 | 
Suggests 
labels of 
logical 
elements and structures | 
Provides suggestion
for physical
structure |
| 
User
mode | 
Automated | 
Semi-
automated
Correction 
recommended
 | 
Fully-
automated
after defining
a profile
 | 
Automated
Correction
recommended | 
Automated
Correction in special cases
 |

## CCS – Offices

- docWORKS – Matching of Image Files and Page Numbers

| Image-file | Pagination | Page-Number |
| --- | --- | --- |
| 000001.tif | Not counted | Np |
| 000002.tif | Not counted | Np |
| 000003.tif | Counted | I |
| 000004.tif | Counted | II |
| 000005.tif | Counted | III |
| 000006.tif | Counted | IV |
| 000007.tif | Counted | V |

| 000008.tif | Counted | VI |
| --- | --- | --- |
| 000009.tif | Counted | 1 |
| 000010.tif | Counted, not paginated | (2) |
| 000011.tif | Counted | 3 |
| 000012.tif | Counted | 4 |
| placeholder | Missing page | 5 |
| placeholder | Missing page | 6 |
| 000013.tif | Counted | 7 |
| 000014.tif | Counted | 8 |

## CCS – Offices

- docWORKS – Structural Analysis

- FRONT

- MAIN

- BACK

## CCS – Offices

- docWORKS – Structural Analysis

- Chapter 1

- Chapter 2

- Subchapter 1

- Subchapter 2

## CCS – Offices

- docWORKS – Structural Analysis

- Preface

- Table of contents

- Title
- page

- Statement page

## CCS – Offices

- docWORKS – Document layers

- Various document layers are differentiated automatically and while using certain levels enable well directed searches as well as the presentation of electronic text without unnecessary items
- Body text independently from its presentation
- Margin notes, footnotes
- Pictures and captions
- Advertisement
- Annex and supplements
- Navigation layer: Table of contents, running title, document index , page number, volume index
- Book: Separation of „intellectual“ and „artifical“ content

## CCS – Offices

- docWORKS – Digitization of books and journals (METAe)

## CCS – Offices

- docWORKS – Digitization of books and journals (METAe)

## CCS – Offices

- docWORKS – Digitization of scientific documents

## CCS – Offices

- docWORKS – Manual editing of descriptive metadata / volume

## CCS – Offices

- docWORKS – Manual editing of descriptive metadata / illustration

## CCS – Offices

- docWORKS – Basic Workflow

**Digitization**
**Scanning**

**DB**
**OPAC****MARC**

**Quality Control**
**Images**

**Conversion**

**Quality Control**
**Output**

**Export**

**Presentation**
**XML/METS**
**PDF**

## ....

- docWORKS – Scalable Client / Server architecture

**Server 1**

**Server 2**

**Server n**

**....**

**Scan**
**Import**

**Quality**
**Control**

**Server 3**

-   **Auto-Import**
**  ****Image Preprocessing**
**  ****Layout Analysis**
**  ****OCR**
**  ****Structural Analysis**
**  ****Export**

## CCS – Offices

- docWORKS – METS / ALTO

- METS

- document

## CCS – Offices

- docWORKS – METS

- Header
- MODS or DC, descriptive metadata
- NISO 39.087 (mix), technical metadata
- Structural Map: Physical Structure
- Structural Map: Logical Structure

## CCS – Offices

- docWORKS – ALTO

- Styles
-       - Paragraph (alignment, linespacing, etc.)
-       - Font (name, size, bold, italic, etc.)
- Layout
-       - Printspace
-       - TopMargin
-       - InnerMargin
-       - OuterMargin
-       - BottomMargin
- Objects in 5 areas above:
-       - Text block
- 	  - Text lines
- 	     - Strings [coordinates, string (as
-               printed), substitution (hyphenation)]
- 	     - Spaces
-       - Composed block
-       - Picture
-       - Table
-       - Formula

## CCS – Offices

- docWORKS – METS / physical structure

**METS**

## CCS – Offices

- docWORKS – METS / physical structure

**METS**

**DIV**
- (page)

## CCS – Offices

- docWORKS – METS / logical structure

**METS**

**DIV**
- (paragraph)

## CCS – Offices

- docWORKS – ALTO / page layout and text content

## CCS – Offices

- docWORKS – ALTO / hyphenated word

## CCS – Offices

- docWORKS – ALTO / hyphenated word

## CCS – Offices

- docWORKS – Workshop UK 2004

- University Library of Southampton
- 	September 28/29, free of charge
- 1st day
- Product information
- Output, metadata standards
- Workflow, use cases
- 2nd day
- „Hands on“ – Working with your own samples
- Individual consultancy sessions
- Contact
- Simon Brackenbury - s.c.brackenbury@soton.ac.uk
- Hartmut Janczikowski - hartmut.janczikowski@ccs-gmbh.de

## Thank you!

- Claus Gravenhorst
- claus.gravenhorst@ccs-gmbh.de
- Content Conversion Specialists
- www.ccs-gmbh.de
- http://meta-e.uibk.ac.at/