14th CODH Seminar
100 Recipes for IIIF Curation Platform

Ideas for Using the IIIF Curation Platform
to Bring Out the Full Potential of IIIF
Asanobu KITAMOTO(ROIS-DS Center for Open Data in the
Humanities / National Institute of Informatics)
http://codh.rois.ac.jp/
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

1

Introduction
2021/2/18

100 Recipes for IIIF Curation Platform #codh142

1★
What is IIIF ("triple-I F")?
IIIF = International Image
Interoperability
Framework

Web: HTML
Images: IIIF
2021/2/18

IIIF
service 1
IIIF
service 2
IIIF
service 3

100 Recipes for IIIF Curation Platform #codh14

4th CODH Seminar
A New Trend on Image
Delivery in Digital Archives—IIIF's Potential forStandardization andSophistication of Image
Access—http://codh.rois.ac.jp/semina
r/iiif-image-access-20170727/

IIIF viewer
1
IIIF viewer
232★
What is curation?

"Curation" is a word that originally means
activities at museums such as collecting materials
and exhibiting artworks.

1. Collect materials under acertain theme.
2. Arrange them in an
appropriate order (layout).
3. Present or share theresult as a new material.
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

Scissors

Glue

Source: Irasutoya
43★
Creation and publication of a curation

Depiction of a Homely Woman: Suetsumuhana
http://codh.rois.ac.jp/pmjt/curation/2/
2021/2/18

Facial Expression Data: British portraits
http://codh.rois.ac.jp/curation/exhibition/2/

100 Recipes for IIIF Curation Platform #codh14

5

4★
What is the IIIF Curation Platform?

1. A software suite for introducing the concept ofcuration to the world of IIIF.
2. There are 7 pieces of software running on a web
browser, 1 application designed for a specificpurpose, 3 Python programs running on theserver side, and 1 Docker setting for supporting
installation. All of these are open source.
3. It is not for competing with well-known IIIF
viewers (e.g., Mirador, Universal Viewer). It is
Logo of the IIIF Curation Platform
focused on bringing out the full potential of IIIF.
http://codh.rois.ac.jp/icp/
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

6Viewing IIIF Images
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

7

5★
Viewing books with the IIIF Curation Viewer
Japanese books
viewingDirection:right-to-left;

Western books
viewingDirection:
left-to-right;

Japanese Pre-modern Text Dataset
http://codh.rois.ac.jp/pmjt/
2021/2/18"Toyo Bunko Collection" Rare Books Archive
http://dsr.nii.ac.jp/toyobunko/

100 Recipes for IIIF Curation Platform #codh14

8

6★
IIIF Curation Viewer Embedded

North China Railway Archive
http://codh.rois.ac.jp/north-china-railway/
2021/2/18

1. The standard IIIF Curation Viewer
is designed as a full-page tool.
2. The IIIF Curation Viewer Embedded
is integrated in a web page tocombine with other information.
3. There are unique functions only inthis viewer, while functions not
relevant for the embedded version
are not implemented.

100 Recipes for IIIF Curation Platform #codh14

9

7★
Switchable display between multiple images

2021/2/18

100 Recipes for IIIF Curation Platform #codh14

108★
Archives of scientific data (ledgers)

Digital Typhoon: Weather Ledger Archive
http://agora.ex.nii.ac.jp/digital-typhoon/genbo/
2021/2/18

1. IIIF is also useful for delivering longterm scientific data like the ledgers.
2. Images with sequence numbers areconverted to Tiled Pyramidal TIFF
format, and linked from the IIIF
manifest.
3. The enlarged region does notchange as you turn the page. This isconvenient when you want totranscribe a specific section of theledger.

100 Recipes for IIIF Curation Platform #codh14

11

9★
Time series image archives
1. Displays high-resolution images(11,000 pixels x 11,000 pixels)
observed by the Himawari weather
satellite.
2. “Prev" and “next" moves along time
instead of pages. The date can also be
selected from the calendar.
3. This use case cannot be properly
handled in the current IIIF framework,so we independently extended theTimeline API and Cursor API.
Digital Typhoon: Weather Satellite 'Himawari' Viewer
http://agora.ex.nii.ac.jp/digital-typhoon/himawari-3g/clipping/2021/2/18

100 Recipes for IIIF Curation Platform #codh14

12

10 ★★
IIIF Curation Platform and Curation API
IIIF Curation Platform

Curation API• An open source software suite
implementing new specifications
such as the Curation API.
• The system works with many
tools; not just a viewer, but also
data storage, search, etc.
• Digital tools for specific needs
have also been developed.

• Proposed as API specifications that
extend official IIIF specifications.
• The API itself can also be used withother tools. The IIIF Curation
Platform is a reference
implementation of the API.
• The official IIIF specifications arefrom the provider perspective.
Curation, on the other hand, isfrom the user perspective.

2021/2/18

100 Recipes for IIIF Curation Platform #codh1413

11 ★★★
Non-standard APIs for extending IIIF
• Curation API• Enables cross-manifest grouping, taking a rectangular region
contained in a canvas as the minimum granularity.

• Timeline API• Enables viewing of materials for which a one-dimensionalsequence can be defined, using time as a unit instead of a page.

• Cursor API• Enables cutting out a part of the list of canvases, when the list in a
manifest is very long (e.g. Timeline).
Case Studies of IIIF-Based Delivery and Use of High-Quality/High-Definition Images,
http://codh.rois.ac.jp/iiif/

2021/2/18

100 Recipes for IIIF Curation Platform #codh14

14

12 ★
Login to the IIIF Curation Platform
There is a loginfunction at theupper right of
the IIIF Curation
Viewer screen

2021/2/18• Uses Firebase authentication from
Google.
• Login is not necessary, but if you login,
you can take advantage ofauthorization management for ICP.
• Some ICP services (kuzushiji
recognition, etc.) require login, but
services are basically free of charge.
100 Recipes for IIIF Curation Platform #codh14

15

IIIF Image Curation
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

16

13 ★
Image curation
2
1

2021/2/18

1. ■ is the "crop" button →Selects a rectangular region
2. ☆ is the "favorite" button →Collects regions you need

100 Recipes for IIIF Curation Platform #codh14

17

14★
Saving a curation

1. Curations created can be downloaded locally, but it is convenient to export andsave them on our service (JSONkeeper).
2. Saving a curation normally means creating a new one, but overwriting theexisting one (update) is also possible.
3. Curation exported with login information can prevent being updated by otherpeople.
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

18

15 ★
Publication of curation
View with IIIF Curation Viewer
Create curation
Save and publish curation to
JSONKeeper.
Read curation into IIIF
Curation Viewer
View with IIIF Curation Viewer
2021/2/18

1. Curations saved on our service(JSONkeeper) can be shared withothers by its unique URL.
2. Saved curations can be viewed again
with the IIIF Curation Viewer.
3. Curations cannot be searched. Searchrequires other tools such as the IIIF
Curation Finder (to be introduced in
the next presentation).
100 Recipes for IIIF Curation Platform #codh14

19

16 ★
Management using the IIIF Curation Manager• Curations exported after
login can be listed on the
IIIF Curation Manager.
• Curations can be edited
and deleted.
• Curations can be viewed
from the IIIF Curation
Player and the IIIF
Curation Board.
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

20

17 ★★
Editing using the IIIF Curation Editor• A curation data in the
JSON format can beedited using the JSON
editor.
• You can also add orchange metadata.
• This may not be usefulfor a large-scale
editing work.
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

21

18 ★
Exhibition using the IIIF Curation Player
1. Functions for"exhibiting" curations
are implemented.
2. Curation metadata
can be displayed as anoverlay on the image.
3. The slide show
function allows theautomatic playback offrames.
2021/2/18

100 Recipes for IIIF Curation Platform #codh1422

19 ★★★
Linkage with museum exhibitions• For the North China
Railway Archive, linking isdone using a QR code
between a museum
exhibition (offline) and an
ICP exhibition (online).
• A smartphone can be used
as a simple exhibition
If you capture the QR code ofguide.
the museum's exhibition room,• This also enables longthe corresponding frame isdisplayed on the IIIF Curation
term archiving ofPlayer.
exhibition content.
AI/Technology: North China Railway Archive, http://codh.rois.ac.jp/north-china-railway/technology/
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

23

20 ★★★
Development of a viewer for museum exhibitions
A viewer built by
Association Press
displays data in an
ICP Docker version
for a "Yoshitoshi"
exhibition at theMuseum of Art, Kochi.

1. The curation function of the IIIF Curation Viewer is used to attachannotations to images (region designation and metadata input).
2. Curations saved on the CODH server are displayed during the exhibition.
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

24

Exporting IIIF Images
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

25

21 ★
Function for exporting a selected region
Clipping

A URL indicating
the selected
region can be sent
to an external
service

http://agora.ex.nii.ac.jp/cgibin/iiif/clipping.pl?image=http%3A%2F%2Fagor
a.ex.nii.ac.jp%2Fdigitaltyphoon%2Fiiif%2F2021%2F02%2F17%2F20210
217041000.tif%2F2822%2C3082%2C3408%2C2
832%2Ffull%2F0%2Fdefault.jpg&lang=ja

ThumbnailFull
resolution

2021/2/18

100 Recipes for IIIF Curation Platform #codh14

26

22 ★
KogumaNet kuzushiji recognition service

KogumaNet Kuzushiji Recognition Service
http://codh.rois.ac.jp/char-shape/app/single-mobilenet/
2021/2/18• In this kuzushiji (cursive
character) recognition service,
AI recognizes a character inthe selected region, anddisplays an ordered list of
character candidates.
• The service runs in a browser
using Tensorflow.js.
• It uses the image exportfunction of the ICViewer.

100 Recipes for IIIF Curation Platform #codh14

27

23 ★★
Exporting to a general image service
Search of ukiyo-e.org
for similar images

Cropped from IIIF image of Keio
University
2021/2/18

100 Recipes for IIIF Curation Platform #codh14• Work with webservices thattakes an image as
input and returns
processed results
as output.
• It is also possible
to start up an
API on one'sown.
28

24 ★★
Cropped image export plugin

ICP Service Repository
http://codh.rois.ac.jp/icp/service-repository/
2021/2/18

1. Create a JSON file describing
the endpoint setting.
2. You can change the export
endpoint of the ICViewer by adrag & drop of this JSON.

100 Recipes for IIIF Curation Platform #codh14

29

IIIF Image Annotation
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

30

25 ★
Curations and annotations

Edo maps β
version "Map of
Hongo Yushima",
National Diet
Library2021/2/18

1. Curation: Selecting and collecting apart of images (defined in theCuration API).
2. Annotation: Adding and displaying
annotations for images (defined in
the Curation API)
3. This is different from annotation in
the IIIF Presentation API (However,
the two are mostly interoperable).
100 Recipes for IIIF Curation Platform #codh14

31

26 ★
Annotation view mode (map)• Annotations can bedisplayed as anoverlay on the image.
• By using the marker
and info window, it
is possible to offer
user experiencesimilar to using a
Web-based map.
Edo maps β version, http://codh.rois.ac.jp/edo-maps/
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

32

27 ★
Building cross-institutional digital archives• Access NDL for
map image• CODH displays
only markers as
an overlay
National Diet Library Digital Collections "Edo Kiriezu Map"
https://dl.ndl.go.jp/info:ndljp/pid/1286656
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

Edo maps β version
33

28 ★
Annotation view mode (characters)

Box frame markers

Character markers(standard mode)

The Tale of Genji (Collection of the National Institute of Japanese Literature)
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

Character markers(overwrite mode)
34

29 ★
KuroNet kuzushiji recognition service

KuroNet Kuzushiji Recognition Service
http://codh.rois.ac.jp/kuronet/

2021/2/18

100 Recipes for IIIF Curation Platform #codh14• Kuzushiji multicharacter
recognition service
recognizes all
cursive charactersin an exported
image.
• It takes about 1–3
seconds for therecognition of asingle image.
35

30 ★
Displaying results of kuzushiji recognition• It is possible to display charactermarkers on the IIIF Curation Viewer, andread them while comparing withcharacters in the background image.
• If you click on a character, its Unicode isdisplayed with a link to the web page
showing other kuzushiji examples withthe same Unicode.
• Settings like transparency, display
position, and size of characters can bechanged to allow users select a display
setting for their convenience.
2021/2/18

100 Recipes for IIIF Curation Platform #codh1436

31 ★★
Designating the reading order using the KuroNet Text
Editor
1. The character reading order for the resultof KuroNet recognition can be
automatically inferred or manuallydesignated.
2. The sequence within and between lines
can be manually designated using the
KuroNet Text Editor.
3. The character reading order can also bemade visible with the KuroNet Text Editor.
4. Functions specially required by a domainspecific application can be added to the
IIIF Curation Viewer.

2021/2/18

100 Recipes for IIIF Curation Platform #codh14

37

Sophisticated Use of ICP
2021/2/18

100 Recipes for IIIF Curation Platform #codh1438

32 ★★
Use in data structuring

Adding metadata by
selecting a partial
region of an image hasa wide range ofapplications.

Bukan Complete Collection
http://codh.rois.ac.jp/bukan/
2021/2/18

100 Recipes for IIIF Curation Platform #codh1439

33 ★★★
Building a digital archive using ICP• Curation URLs are made into a list, and a program reads that out from
JSONkeeper, and converts to a format suited to an external system.
• Building a digital archive with a help of the IIIF Curation Platform.
2021/2/18

100 Recipes for IIIF Curation Platform #codh1440

34 ★★★
Creation of an online pictorial collection

Digital Typhoon: Weather Satellite 'Himawari' Pictorial Collection
http://agora.ex.nii.ac.jp/digital-typhoon/contribution/gallery/
2021/2/18

100 Recipes for IIIF Curation Platform #codh1441

35 ★★★
Linkage of JSONkeeper and Canvas Indexer• JSONkeeper:Service for savingand delivering datain JSON format.
• Canvas Indexer:
Service for crawling
JSONkeeper data,
breaking down into
canvas units, andenabling searching.

2021/2/18

ICViewer
Curation
JSON

ICFinderJSONkeeper

IIIF Change Discovery
API 0.1
conformance level 2
Activity streams

Harvests
curations
updated since
the last time

Canvas Indexer
100 Recipes for IIIF Curation Platform #codh1442

36 ★★★
Linkage of Canvas Indexer and machine learning
Canvas Indexer

Tag: Circle

Image URL
to be usedby machinelearning
service issent

Results (machinetags) for theimage URL are
returned to CI

Machine learning service
2021/2/18

100 Recipes for IIIF Curation Platform #codh1443

37 ★★★
Curation search using Canvas Indexer

Collection of Facial Expressions
http://codh.rois.ac.jp/face/iiif-curation-finder/
2021/2/18• A system for breaking down
data gathered in curation
units into canvas units, andrearranging in metadata
units.
• We are planning to use it
from other systems thanthe IIIF Curation Finder, e.g.
Omeka S.

100 Recipes for IIIF Curation Platform #codh1444

38 ★★★
Curation search using Curation Tracer

Curation Tracer
http://codh.rois.ac.jp/curation/tracer/
2021/2/18• Regions used in curations
can be visualized for eachcanvas or for each manifest.
• This enables analysis ofwhich part of an image
people focusing on.
• In the future, it may become
the analytics for a region ofinterest?

100 Recipes for IIIF Curation Platform #codh14

45

Conclusion
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

46

39 ★
Interoperability of IIIF
1. IIIF has rapidly spread throughout the world because it
meets the common needs of image providers.
2. By delivering data in a common format (ensuring
interoperability), IIIF has made it possible to access images
all over the world using the same tools.
3. As various tools adopt IIIF as a premise, archives notsupporting IIIF are seen as inconvenient.
4. There is heightened "fear of missing out."
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

47

40 ★
Unique features of the IIIF Curation Platform
1. It enables users to create and publish original image collections
based on different themes.
2. It enables users to call and use original image services deliveredfrom service providers other than the image provider.
3. It enables users to provide an overlay display of original annotation
information.
4. As a platform supporting the entire workflow of users freely
collecting, processing, and publishing images, ICP is playing a role inpioneering new uses of IIIF images.
IIIF Curation Platform Cultivating the Usage of Images in the Open World, Current Awareness, No. E2301,
No.398, 2020.09.17, https://current.ndl.go.jp/e2301/
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

48

References1.

Asanobu KITAMOTO, " IIIF Curation Platform Cultivating the Usage of Images in the Open World ", Current
Awareness, No. E2301, September 2020 (in Japanese)2.

Asanobu KITAMOTO, "IIIF Curation Platform: Creating and Sharing Virtual Image Collection on a Global
Scale", 2019 International Conference: Global Humanities in the Era of Hyperconnectivity, September
2019 (Invited lecture) (in English)

3.

Asanobu KITAMOTO, Jun HOMMA, Tarek SAIER, "IIIF Curation Platform: Next Generation IIIF Open
Platform Supporting User-Driven Image Sharing", Proceedings of the 2018 Symposium on Computers andthe Humanities (Jinmonkon 2018), pp. 327-334, December 2018 (in Japanese)

4.

Asanobu KITAMOTO, "Software Development for IIIF and a Road to the Platform for Image Delivery", 4th
CODH Seminar: A New Trend on Image Delivery in Digital Archives — IIIF's Potential for Standardizationand Sophistication of Image Access—, doi:10.20676/00000308, July 20175.

Asanobu KITAMOTO, Kazuaki YAMAMOTO, "Construction of Trans-Disciplinary Data Platform that Explores
Open Data in the Humanities", Proceedings of the 2016 Symposium on Computers and the Humanities(Jinmonkon 2016), pp. 117-124, December 2016 (in Japanese)

2021/2/18

100 Recipes for IIIF Curation Platform #codh14

49

Acknowledgments• Jun HOMMA (FLX Style) and Tarek SAIER (Karlsruhe Institute ofTechnology) are involved as core developers of the IIIF Curation
Platform. I would like to thank them for their tremendous contributions.
• These presentation materials incorporate the results of Chikahiko
SUZUKI, Tarin CLANUWAT, Mika ICHINO et al. of CODH.
• I would like to thank the many people who provided images andcollaborated with this research.

http://codh.rois.ac.jp/icp/
2021/2/18

100 Recipes for IIIF Curation Platform #codh14

50