EyeWear 2018: Second Workshop on
EyeWear Computing
Benjamin Tag
Keio University
Yokohama, Japantagbenja@kmd.keio.ac.jp

Olivier Augereau
Osaka Prefecture University
Osaka, Japanaugereau.o@gmail.com

Christian Holz
Microsoft Research
Redmond, UScholz@microsoft.com

Yuji Uema
J!NS Inc.
Tokyo, Japanyuji-uema@jin-co.com

Paul Lukowicz
DFKI
Kaiserslautern, Germany
paul.lukowicz@dfki.de

Kai Kunze
Keio University
Yokohama, Japan
kai.kunze@gmail.com

Abstract
Virtual/augmented reality headsets, smart sensing glasses
and similar "Smart Eyewear" have recently emerged ascommercial products and can provide an interesting research platform for a range of research fields, including
human-computer interaction, ubiquitous computing, pervasive sensing, and social sciences. The proposed workshop will bring together researchers from a wide rangeof computing disciplines, such as mobile and ubiquitouscomputing, eye tracking, optics, computer vision, human vision and perception, usability, as well as systems research.
The workshop is a continuation from 2016 and will focus on
discussing application scenarios and shared interest use
cases for eyewear computing between corporate and academic researchers.

Author Keywords

Permission to make digital or hard copies of part or all of this work for personal orclassroom use is granted without fee provided that copies are not made or distributedfor profit or commercial advantage and that copies bear this notice and the full citationon the first page. Copyrights for third-party components of this work must be honored.
For all other uses, contact the owner/author(s).
Copyright held by the owner/author(s).
UbiComp/ISWC’18 Adjunct, October 8–12, 2018, Singapore, Singapore
ACM 978-1-4503-5966-5/18/10.
https://doi.org/10.1145/3267305.3274140964

Eyewear, Head-mounted Displays, Smart Glasses, VirtualReality, Augmented Reality, Activity Recognition, PerceptionAware Computing, Human Augmentation

ACM Classification Keywords
H.5.m [Information interfaces and presentation (e.g., HCI)]:
MiscellaneousIntroduction
We often believe the face to be a reflection of our personality or character. It holds most of our senses - sight, hearing, taste, smell and is used to express affect. Head andface seem to be an obvious choice to place sensors andactuators to track user’s activities and provide interaction
possibilities [1, 6].

Figure 1: Examples of commercial
Smart Eyewear. Sony Smartglasses, Microsoft Hololense, J!NSMEME.

However, for a long time, head- and face-based wearables
have been restricted to special purpose, niche applications.
While hearing aids and mobile headsets are widely accepted as head-worn devices, users in public spaces often
consider novel head-attached sensors and devices as uncomfortable, irritating, or stigmatizing. Yet, given a numberof recent technological developments, we believe eyewear
computing will soon transition into mainstream technology
and become a prominent research field. In essence, because the face is so important to humans, under every day
circumstances people are highly sensitive to ergonomic andsocial acceptance aspects of anything placed there. It is
telling that in early wearable computing ergonomic studies
the head was not even included [2]. Early egocentric vision
devices were rather bulky, expensive, and their battery life
severely limited their usage [4]. Building on existing work inwearable computing, recent commercial egocentric vision
devices and mobile eye trackers, such as Google Glass,
SMI ETG, and J!NS meme, pave the way for a new generation of "Smart Eyewear" that is light-weight, low-power, convenient to use, and increasingly looks like ordinary glasses
adding to its unobtrusiveness [3, 5].
This workshop proposal is motivated by the observation
that, through a combination of consumer attitude shifts andtechnological advances, complex head/face-based sensing/interaction is becoming more feasible for use in everyday situations. In recent years eyewear computing has left

the mere academic research domain and entered commercial markets with viable products (see Figure 1). Recentadvances in real-life tracking of physical and cognitive activities and states (e.g. reading, walking, detection of fatigue,cognitive load) are enabling technologies for additional application fields towards a quantified self for the mind [7].
The workshop is a continuation of the first EyeWear 2016at UbiComp Heidelberg, which focused mostly on enabling
technologies. We will still discuss enabling sensors andactuators, yet in contrast to 2016, we will focus more on
application scenarios and creating the academic and corporate connections for an open eyewear platform to foster
exchanges in sensing, interaction, hardware and softwareknow-how.

TopicsAs Smart Eyewear can be a powerful enabling technology
for a broad range of research fields, we plan to tackle thefollowing topics during the seminar with a special focus on
forming a community to exchange hardware designs, requirements, best practices and source code to build and run
Smart Eyewear prototypes. The areas of interest include:
Novel application cases: Which activities are the mostuseful for application cases that have the most impact onsociety. What are the best application fields to apply Smart
Eyewear for the strongest social impact?
Suitable Sensing and actuation technologies: Driven
by the application cases, which sensing modalities are themost interesting to be integrated in Smart Eyewear? What
are the important activities and measures to focus on (e.g.
fatigue detection, concentration tracking)?
Impact and perils of long-term sensing: How can we
use these real life recordings of physical, physiological andcognitive signals on the head? What are potential negative965

effects of long term usage, ranging from perceptual issues
regarding the use of wearable displays (binocular rivalry,vertical and horizontal gaze comfort, instrument myopia,
eye strain, accommodation-convergence mismatch) to potential skin irritations during the deployment of electrodes orother sensors necessary to touch the skin.
Towards an Open Eyewear Platform: How can we build
up an international community to share scientific results
and work together on topics related to Smart Eyewear. Especially large scale, long-term monitoring of cognitive capacities, promises to have a strong impact on psychology,sociology, and cognitive science. Eyewear computing canbe an enabling technology to transform these domains frommodel- to rather data-driven sciences utilizing real world
setups instead of controlled laboratory settings.

ACTIVITIESWe propose a one-day workshop on the 8th of Octoberwith presentation sessions in the morning, development of
scenarios in the early afternoon, and group discussions on
fundamental challenges in the late afternoon. In the following we describe pre-workshop preparations and the postworkshop follow up.
Presentations
The workshop will start with an introduction and the keynote
to the workshop topic (10:00-12:30), followed by short introductory presentations to get familiar with the participants
and the topics they are working on. Keynotes will be given
by Prof. Thad Starner and Ozan Cakmakci (both tentativelyconfirmed). Ozan Cakmakci is a lead optical research anddevelopment engineer focusing on future optical architectures for Google Glass at Google[x]. Prof. Starner is thedirector of the Contextual Computing Group (CCG) andis also the longest-serving Technical Lead/Manager on966

Google Glass. Authors will get 5 minutes to present theirwork keeping presentations short and focused. While listening to the presentations, all participants will be asked
to take notes on provided Post-Its, which we will share ona large whiteboard in order to prepare for the discussion
sessions. The presentation session will be broken into twoparts with a short coffee break in between. This will allow
enough time to discuss different ideas coming out from thepresentations.
Demonstration Session
We encourage participants to bring and show demonstrations of research prototypes related to their submissions.
Depending on the number of demonstrations we will hold aseparate demonstration session or do small show-and-tellsin the coffee breaks.
Scenario Development
After the presentation sessions, grouped participants will
start developing scenarios. All participants will write notes
on Post-Its, which will be added to the Post-Its from themorning session on the whiteboard. In order to sort out
the challenges and opportunities for an Open Eyewear Platform, we will create an affinity diagram analysis of the PostIts. Group analysis will start at 15:00 and will end at 15:30.
Group Discussion
After the group analysis, we will have a longer coffee break(15:30-16:00) followed by a discussion round on identified
challenges and opportunities (16:00-17:00). Organizers will
actively engage with the audience to stimulate discussions.
We will summarize the key experiences from the workshop
and will plan follow up activities (17:00-17:30).
Post-Workshop Follow Up
At the workshop, organizers will take pictures/document theoutcome of the analysis and the content on the whiteboard.

This will be made available to the all participants througha shared Google Drive folder. Participants will be invited
to an existing Slack channel where they can share papersrelevant to the workshop themes.

Acknowledgements
This workshop is based on a Dagstuhl Seminar on EyeWear Computing No. 16042 http://www.dagstuhl.de/16042. This work is also partly supported by JST CREST Grant
No. JPMJCR16E1 andOrganizers
Benjamin Tag is a researcher at Keio University Graduate School of Media Design working on Smart Eyewear
research topics focusing on fatigue detection in real life situations and on creating feedback loops for responsive mediausing head worn sensing.
Oliver Augereau is a Research Assistant Professor at Osaka Prefecture University in the Intelligent Media Processing Group which is supervised by Professor Koichi Kise.
He uses devices such as cameras, eye-trackers, and smart
glasses in order to get information from reading activity. He
also researches "experiential supplements", which aim at
creating new tools for sharing experiences for improving
learning and education.
Christian Holz is a researcher at Microsoft Research, Redmond, WA, focusing on novel human-computer interfaces,
small and wearable devices, sensing systems, and signalprocessing.
Paul Lukowicz is Full Professor of AI at the Technical University of Kaiserslautern/Germany and head of the Embedded Intelligence group at DFKI. His research focus iscontext-aware ubiquitous and wearable systems including
sensing, pattern recognition, system architectures, modelsof large scale self-organized systems, and applications.
Kai Kunze works as an Associate Professor at Keio University Graduate School of Media Design. His major researchcontributions are in pervasive computing with a focus onhuman agumentation.

REFERENCES
1. Oliver Amft, Florian Wahl, Shoya Ishimaru, and Kai
Kunze. 2015. Making regular eyeglasses smart. IEEE
Pervasive Computing 14, 3 (2015), 32–43.
2. Kerry Bodine and Francine Gemperle. 2003. Effects offunctionality on perceived comfort of wearables. InISWC 2003, Vol. 1530. 17–00.
3. Andreas Bulling and Thorsten O Zander. 2014.
Cognition-aware computing. Pervasive Computing,IEEE 13, 3 (2014), 80–83.
4. Ozan Cakmakci and Jannick Rolland. 2006. Head-worndisplays: a review. Display Technology, Journal of 2, 3(2006), 199–216.
5. Reinhold Kliegl and et al. 2006. Tracking the mind
during reading. Journal of experimental psychology
135, 1 (2006), 12.
6. Jochen Kuhn, Paul Lukowicz, and al et. 2016. gPhysics- Using Smart Glasses for Head-Centered,Context-Aware Learning in Physics Experiments. IEEE
Transactions on Learning Technologies 9, 4 (2016),
304–317.
7. Kai Kunze, Katsutoshi Masai, Masahiko Inami, ÖmerSacakli, Marcus Liwicki, Andreas Dengel, Shoya
Ishimaru, and Koichi Kise. 2015. Quantifying reading
habits: counting how many words you read. In
UbiComp 2015. ACM, 87–96.

967