NTCIR14-Lifelog3
Task Introduction

Cathal Gurrin1, Hideo Joho2, Frank Hopfgartner3, Duc-Tien Dang Nguyen1, Liting Zhou1, Rami
Albatal4
1Dublin City University, 2University of Tsukuba, 3University of Sheffield, 4IdenTV

Life Experience
Digital Self

How to create a digital lifelog of life
experience without manual input…
activities, experiences, interactions,emotions? … and make it useful…

This year, we
introduce afocus on
Activities &Wellness

Novelty of NTCIR14-Lifelog3•New rich data (60 days, N people), fully anonymised•Three sub-tasks:••LSAT - Lifelog Semantic Access Task•

LIT - Lifelog Insights Task

•LADT - Lifelog Activity Detection Task

Potential to also have a co-located workshop inEurope

Data Summary•

Two months of rich lifelog data from two people•

2 x 30 days each, all day data (about 15GB)•With accompanying event segmentation, dietannotation and automatic visual-annotation•

Data released via individual and organisational
agreement (as at NTCIR-12)•

Minimal anonymisation of the data

01

Wearable Multimedia

Human Biometrics

2,000 images per day fromthe Autographer wearablecamera. Accompanying
concept annotations. Audiolevels. Manual photos
captured. Music listening
history.

24x7 heart rate, blood sugar,
calorie burn, steps, skintemperature. Daily bloodpressure. Weekly cholesterol
measurements.

MINUTE AS
THE UNIT OFRETRIEVAL

020403
Information Access

Human Activity

Onscreen reading,
keystrokes on keyboard,mouse movements,
computer activity, webpages viewed.

Physical activities (walking,running, transport, etc..),locations visited, foodeaten,.

Sub-tasks•

LSAT - Known-item search (repeat fromNTCIR-12/13) Subtask•LIT - Lifelog Insights Subtask•LADT - Lifelog Activity Detection Subtask

Aug 18

Jan 19Mar 19Paper Due

Submission DueData

Submission of Task
Paper for review

Submissions for allsubtasks due

Dataset Release

June19
Task Guidelines
For all three tasks to bereleasedJun 18Topic Release

Results Release

Test Topic Release

Results of all subtasks
released

Sept 18

Feb 19

LAT - Lifelog Activity
Detection Subtask
A multimodal annotation task to automatically annotate the lifelog datawith human activities.

Kahneman et al. A survey method for characterizing daily life experience: The day reconstruction
method. Science, 306(5702):1776–1780, 2004.

LSAT - Known-item Search
A known-item search task in which participants have toretrieve a number of specific moments in a lifelogger's life. We
define moments as semantic events, or activities that
happened throughout the day. LSAT can be undertaken in aninteractive or automatic manner. We will provide a base-line
retrieval engine (via API) for participants who want to build
an interactive LSAT system.
Example search tasks include:
Find the moment(s) where I was boarding an A380.
Find the moment(s) where I am in my kitchen.
Find the moment(s) where I am playing with my phone.
Find the moment(s) where I am preparing breakfast.

LIT - Lifelog Insights Task
The aim of this subtask is to gain
insights into the lifelogger's life in termsof diet and health. This task is notevaluated in the traditional sense, butparticipants will be expected to present
their work in a special session at
NTCIR. An event segmentation will bedefined for the data.

ありがとうございますfrom:
NTCIR-14 Lifelog Organisation TeamWebsite (Apr 2018): ntcir-lifelog.computing.dcu.ie
Contact Email: cathal@gmail.com