Use of Digital Archives with
IIIF Curation Platform
Satoru NAKAMURA(Historiographical Institute, The University of Tokyo)
1

Toward use of digital archives (based on informatics)
ProvidersStandards/Technologies linking
providers and users

UsersMetadata●●●Digital archives○ Sustainability○ OSS (Open SourceSoftware)
DOI (Digital Object
Identifier)
Use conditions/license○ CC License○ PDM(Public DomainMark)LOD (Linked Open Data)
RDF●Images
IIIF(International Image
Interoperability Framework)●●Text…

TEI(Text Encoding Initiative)

Research/Education○ Machine learning○ Digital Humanities○ Open science
Dissemination○ Exhibitions○ Digital exhibitions
Scholarly communication○ Across institutions○ Across subjects…

2Outline of this presentation● Digital archive projects○

The University of Tokyo "Kunshujo" (a collection of scrapbooks)○

The University of Tokyo "The Tale of Genji"○

The University of Tokyo "Hieratische Paläographie DB"○

The University of Tokyo "Letter of Shelley"○

Cultural Japan "Self Museum"○Toyo Bunko "Daimin-chiri-no-zu" (Edo period map of East Asia)○

Individual research "Arrangement of data from Ottoman-Turkish documents"● ICP-related tools

3The University ofTokyo"Kunshujo"
Development of Content Search System of"Kunshujo" with IIIF and Open DataSatoru NAKAMURA
Journal of the Japan Society for Digital
Archive, 3(2) 155–158, March 2019https://doi.org/10.24506/jsda.3.2_155

4https://iiif.dl.itc.u-tokyo.ac.jp/repo/s/tanaka

Tanaka Yoshio: Natural History Collection, Distributed on August 6, 2018

5

Topic: Pasted materials on the pages can not be searched.

6

Recipe N1 - IIIF Curation API - ★★★

ExampleManagement ofcropped imageinformation

7

Recipe N2 - IIIF Curation Viewer
Embedded - ★★

Recipe N3 - IIIF Curation Player - ★

Display of imagewith metadata
Simple display of image
8Recipe N4 - IIIF Curation API - ★★★

Recipe N5 - IIIF Curation Viewer - ★

Prototype of pasted
item image search●Automatic extraction of pasted
items using deep learning(object detection)●

Use of 2,713 manually-createdannotations as teaching data●

Management of cropped image
information using the IIIF
Curation API

Development of Content Retrieval System ofScrapbook “Kunshujo” using IIIF and Deep Learning
Satoru NAKAMURA
2019 IIIF Conference, June 2019https://iiif.io/event/2019/goettingen/program/38/

Image display using
the IIIF CurationViewer

Use in a machinelearning pipeline

Example9

Recipe N6 - Special-Purpose Tool - ★★★

ExampleApplication:
Visualization of largescale image collections

Function: Use of IIIF
curation list as input
dataSource code
https://github.com/YaleDHLa
b/pix-plot
10

The University of Tokyo"The Tale of Genji"
Use of IIIF/TEI in Development of the Genji Monogatari
Textual Research Support System "Digital Tale of Genji"
Satoru NAKAMURA, Takashi TAMURA, Kiyonori NAGASAKI
Research Report – Humanities and Computers (CH) 2020CH-124(2) 1–7, September 2020 (in Japanese)
http://id.nii.ac.jp/1001/00206588/11

Digital Tale of Genji
By collecting and creating various types of data relating to the Tale of Genji, and linking them to the text, this systemaims to provide an environment to assist Tale of Genji research, as well as education and research activities usingclassical documents

Images of the Tale of Genjiopen to the public
Digital Tale of Genji
University of Tokyo General Library

Aiming to be a platform for textual
research on the Tale of GenjiTale of Genji, translation into modernJapanese, text open to the publicAozora Bunko(translated by Akiko Yosano)

Uses results of "TEI at Aozora Bunko"
TEI-C East Asian/Japanese SIG(old movable (wood black printing with notype version) postscript and no colophon)

Koui Genji
Monogatari:
A monographcomparing the main
texts of the Tale of Genji

Images of the Koui Genji
Monogatari open to the public

Kyushu University Library
Kyushu University Collections

Koui Genji Monogatari text DB
National Diet Library
Digital Collections

12

Recipe N7 - IIIF Curation API - ★★★

Examples of functions provided in
the Digital Tales of Genji
Association inpage no. units ofthe Koui Genji
Monogatari

Images of theTales of GenjiManagement ofpage nos. for
multiple images

ExampleText of the Koui
Genji Monogatari

Association insentence units with themodern Japanesetranslation

Modern Japanesetranslation (AozoraBunko, transl. byAkiko Yosano)

13

Recipe N8 - Kuronet・Kuzushiji Recognition Viewer - ★★

ExampleAssignment of page numbers of Koui Genji
Monogatari to images●

Uses the KuroNet Kuzushiji Character OCR
service developed by CODH○●●

Section with shortest
editing distance from thefirst line of each page of theKoui Genji Monogatari text.

Text data in line units is generated by using an
automatic reading order inference algorithm

Edit distance is calculated for the cursive
character OCR text and first line of each pageof the Koui Genji Monogatari text created in①MarkerRecipe N9 - IIIF
Curation Viewer - ★

The page number of the Koui GenjiMonogatari is automatically assigned to theline with the highest similarity, and the result
is manually checked○Precision is roughly 90%

Text conversion of each line using
KuroNet Kuzushiji Character OCR

14

Summary: Developed data (5 main collaborators)
Method(1) Creation of text data forthe Koui Genji Monogatari(2) Assignment of page
numbers of the Koui Genji
Monogatari to distributedimages●●

Created data

Omeka SScripto

TEI-compliant XML files

Kuzushiji Character OCR

Kuzushiji Character OCRtext●●Edit distance
Manually checking

IIIF Curation API compliant
JSON files

Quantity●●

3,977 pages, 1,687,192
characters●●●(3) Association of Koui Genji
Monogatari and modern
Japanese translation●●

Aozora Bunko text
<anchor/> tags

TEI-compliant XML files

54 volumes out of 54
1,812 pages, 856,495
characters

Univ. of Tokyo book
Kyushu Universitybooks (2 types)
Kogetsusho(commentary) (23volumes out of 54)

9 volumes out of 54

15

List of lacunae and pages
out of order●Management of lacunaeand pages out of orderacross multiple manifests

Recipe N10 IIIF Curation API - ★★
Recipe N11 IIIF Curation Viewer - ★
Example16

The University of Tokyo

HieratischePaläographie Database
Development of Hieratische Paläographie DB
Satoru NAKAMURA, Masakatsu NAGAI,
Toshihito WAKI, Yona TAKAHASHI
Proceedings of Jinmoncon 2020, 191–196,
December 2020
http://id.nii.ac.jp/1001/00208595/

17

●University of Tokyo
Asian Research Library
Digital Collection●Hieratic dictionary●More than a century has
passed since publication of
the first volume, but eventoday, this dictionary isessential when learning or
researching hieratic
18

Issues with the Möller dictionary● Möller's (hieratic) character nos. differ from the hieroglyph character nos., and othercorrespondence table is needed.

● Characters can not be searched based on their phonetic value or word consonanttranscription.

● Multiple pages must be checked when searching for interpretation candidates for asingle character.
Old

HieraticNo

New

HieroglyphNo(e.g. A30)

19

Recipe N12 - IIIF Curation API ★★★

ExampleManagement of more than 2,000 pieces of cropped image
information from multiple (3 volumes) items (IIIF manifests)

Recipe N13 - IIIF Curation Viewer
Embedded - ★★

ExampleSimple display of cropped image

Image display with a specificsection of the imageemphasized with a boundary
ExampleRecipe N14 - IIIF
Curation Viewer - ★
20

Recipe N15 - Specific Tool - ★★★

Comparison of images cropped using Mirador

In hieratic, the character shapes of125 and 600 are extremely similar.
There is a possibility that scribes did
not distinguish the two characters.

21

The University of TokyoShelley's Letter22Shelley's letter
Transmitted light image●Handwritten manuscript of Percy Bysshe Shelley(1792-1822) collected as a rare document at theUniversity of Tokyo's General Library●Transmitted light images○○"The fact that the paper of this manuscript has awatermark has also been pointed out by Professor
Tatsuo Tokoo, a leading expert in Shelley research.
Therefore, after imaging the "Fragment of an Address
to the Jews," transmitted light photography was carriedout to reveal the watermark pattern again, and animage was produced with processing to make thewatermark more visible."https://iiif.dl.itc.u-tokyo.ac.jp/repo/s/shelly/page/about

Dolphin watermark

Original image

23

Recipe N16 - IIIF Curation Viewer Embedded - ★★

IIIF applications using transmitted light images

ExampleIIIF Curation
Viewer Embedded

Image
Annotator

Viewer madeby Digirati

Mirador24

Cultural Japan
Self Museum
Usage of Japan Search RDF Model in theDevelopment of Cultural Japan
Satoru NAKAMURA
Journal of the Japan Society for Digital
Archive, 4(4) 348–351, October 2020
https://doi.org/10.24506/jsda.4.4_348

25

Cultural Japan
Opened to the public on August 1, 2020
A system for improving discovery potential
by gathering 1 million data items relating toJapanese culture distributed by institutions
all over the world
https://bijutsutecho.com/magazine/news/headline/22458

IIIF collection and IIIF curation lists aresupported as input formats for the SelfMuseum

https://cultural.jp/26

Recipe N17 – Creation of Data with the IIIF Curation Viewer - ★

Recipe N18 - Related Tools - ★

University of Tokyo, General Library Virtual Museum

Example[Content at the Self Museum]● Pictures of the University ofTokyo from the Meiji era －From the photo album "TokyoImperial University"● A comparative look at picture
scrolls － From the Hyakki
Yagyo ("Night Parade of One
Hundred Demons") －● A la carte items from theGeneral Libraryhttps://www.lib.utokyo.ac.jp/ja/library/general/event/2020112027

Other●Use as a viewer for IIIF
compatible items
IIIF Curation
ViewerKuzushiji
Character
Recognition
ViewerRecipe N19 IIIF Curation Viewer - ★

Recipe N20 Kuzushiji Character
Recognition Viewer - ★
28

Toyo Bunko"Daimin-chiri-no-zu"
Usage of Digitized “Daimin-chiri-no-zu”
Satoru NAKAMURA
Old Maps in Asia: Basic Information andPerspective for New Research, The SeventhInternational Symposium of Inter-Asia
Research Networks, December 8, 2018
http://id.nii.ac.jp/1629/00007055/29

Recipe N21 – Creation of Data with the IIIF Curation Viewer - ★

IIIF Curation Map Search

Recipe N22 - Related Tools - ★

If you click on a place name,that area is displayed enlarged

Application: Display and searching ofa large number of annotations for asingle large image (e.g. a map)
Content: Provides simple search for
IIIF curation lists

Search function

Source code:
https://github.com/nakamura196/i3#iiifcuration-map-search
30

Arrangement of datafrom Ottoman-Turkish
documents
Development of system to support historical
study with on-offline combined tools based on
TEI and IIIF – A case of Ottoman and Turkish
documents
Satoru NAKAMURA, Natsuko SAJI, Kiyonori
NAGASAKI
Proceedings of Jinmoncon 2019, 293–300
December 2019http://id.nii.ac.jp/1001/00201015/
31

Background and purpose●

Applicable historical materials○○●

1,089 historical items, primarily Ottoman-Turkish Documents

Kreševo Monastery and applicable historical materials
○
○
○
○○

●Collection of Kreševo Monastery in Bosnia-Herzegovina○○○

Built at the end of the 13th century, Catholic Franciscan order
Under control of the Ottoman Empire 1463-1878

Documents exchanged between the monastery and Ottoman authorities
relating to routine administrative procedures and monastery operation for
believers in the jurisdictional area
In 1765, the monastery was struck by fire, and many historical materials in
the collection were burned
Primarily documents from the 18-19th century

Characteristics
Newly uncovered historical materials that have not been fully organized andinterpreted
Valuable historical materials for clarifying the lives of Catholic believers andthe role of the Franciscan order under the Ottoman Empire
An initiative to organize and interpret the materials, starting from zero, using
image data as a basis
32

Data Structure● Framework with a three-level structure using div tags, taking●●constituent elements of documents as units
Using the facs attribute to link the description point and image
Definition of constituent elements: type attribute

33

Recipe N23 - IIIF Curation API - ★★★

Advantagesof TEI
2. Use ofvarious kindsof data(applications)

1. Retain text
structure

・Table format
・BI tools

Networkanalysis

Output as an IIIF curation
list

Association withimages (IIIF)

Recipe N24 - Related Tools - ★

OtherDataset for machinelearning (AI)Distribution of resultswith database 34

ICP-RelatedTools

35

IIIF Converter
Application: Tool for conversion
between IIIF manifests and curation
lists

Source code:
https://github.com/nakamura196/i3#iiifconverter

Example36

Recipe N25 - Related Tools - ★

Recipe N26 - Related Tools - ★

Curation => Manifest Example

Manifest => Curation Example

Conversion of a single IIIF manifest to an IIIF
collection composed of multiple IIIF manifests

A IIIF manifest with annotations is converted
to an IIIF curation list, and displayed at theSelf Museum

Conversion to multiple
IIIF manifests

37

Recipe N27 - Related Tools - ★

IIIF Curation Comparison
Application: Application for arranging
and displaying a IIIF curation list ineach window of Mirador

Source code:
https://github.com/nakamura196/i3#iiifcuration-comparison

Example38

Recipe N28 - Related Tools - ★
ExampleParallel display of TEI text and IIIF image

TEI text

Source code:
https://github.com/TEI-EAJ/letter

IIIF Curation
ViewerEmbedded39

Recipe N29 - Related Tools - ★

IIIF Multi Viewer
Application: A tool for easycontent checking and search ofIIIF curation lists

Functions: Provides functions
such as facet search and image
comparison taking an IIIF
Collection and IIIF Curation List asparameters

Source code:
https://github.com/nakamura196/icc240

Recipe N30 - Related Tools - ★★

Rectangle Packing with IIIF Curation
Application: Play

Functions: Program that converts
an IIIF curation list into a single
image (packing individual items intoa single image)Source code:
https://github.com/nakamura196/rpExample

41

Conclusion: Advantage of IIIF Curation Platform● Interoperability○Displaying the cropped image can be left to the IIIF Curation Viewer, etc.

■○

Various tools provided by the IIIF Curation Platform (e.g. ICEditor)

This enables effort to be focused on developing applications in areas other than data creation(ex. search/comparison).

● Ease of management○

One IIIF curation list meets the requirement to manage image regions cropped from multiple
materials (IIIF manifests) together with their respective metadata.

○Ease of data management also promotes long-term preservation of data.

42

Thanks to everyone who provided the images
and collaborated with this research.
Thank you for listening.

43