HaptoMIRAGE
Mid-air Autostereoscopic Display for Seamless Interaction with Mixed Reality Environments
Yuta UEDA*1, Karin IWAZAKI*1, Mina SHIBASAKI*1, Yusuke MIZUSHINA*1
Masahiro FURUKAWA*1, Hideaki NII*2, Kouta MINAMIZAWA*1 and Susumu TACHI*1

Figure 2: Superimposing 3DCG (Red Car)on the Real Object (Stage)

Overview

As shown in Figure 4, Active-shuttered Real-Image
Autostereoscopy (ARIA) (Nii et al, 2012) technology comprises
an LCD display, an active shutter, and a Fresnel lens. TheFresnel lens makes the real image from the LCD display, whilethe transparent LCD panel-based active shutter provides timedivided rays of light for the left and right eyes. The user’s pointof view (PoV) is calculated with a camera-based motion capturesystem and the projected 3D content transformed to his/her
viewpoint. The proposed HaptoMIRAGE system (Ueda et al,2013) comprises three ARIA units, each with 50 degrees
autostereoscopic field of view, resulting in a total of 150 degrees,
which enables three users to experience the contents fromdifferent viewpoints simultaneously.
E-mail: haptomirage@tachilab.org

Active shutterFresnel Lens

Autostereoscopic
Real imageer2

Active-shuttered Real-Image Autostereoscopy

LCD display

Us

HaptoMIRAGE is a simultaneous multi-user autostereoscopic
display for seamless interaction with mixed reality environments.
This system can project 3D contents in mid-air and enable as
many as three participants observe the same contents with a 150
degrees wide-angle view. The system can be used in several
scenarios, such as superimposition of 3D content onto real
objects, and multi-user collaborative drawing in the real world.
Further, users can interact with the 3D content, such as rotating
it and viewing it from different angles, allowing them to easily
create and feel the mixed reality world via tangible objects withmulti-modal sensations.

Figure 3: Drawing 3DCG (Flower)
on the Real Object (Pot)

Left-eye view

Right-eye view

er3

Figure 1: System Appearance

Graduate School of Media Design, Keio University*2
IIJ Innovation Institute, Inc.

Us

*1

User1

Figure 4: HaptoMIRAGE System Overview

User Experience
Siggraph attendees can observe and interact with mid-air 3D
contents superimposed onto real objects without wearing any
special glasses. They can also create colorful line drawings onreal objects using a pen-shaped device, as they would naturally
do with their hand in the real world. These line arts can becreated in collaboration with multiple users and do not fade overtime, so they can be edited anytime thereafter.

Acknowledgment
This work is supported by the JST-CREST “Haptic Media”
project.

References
Y. Ueda, N. Hanamitsu, Y. Mizushina, M. Shibasaki, K.
Minamizawa, H. Nii, S. Tachi, HaptoMIRAGE: A multi-user
autostereoscopic visio-haptic display, ACM SIGGRAPH 2013
Posters, p. 73, 2013.

Permission to make digital or hard copies of part or all of this work for personal orclassroom use is granted without fee provided that copies are not made or distributedfor commercial advantage and that copies bear this notice and the full citation on thefirst page. Copyrights for third-party components of this work must be honored. For allother uses, contact the Owner/Author.
SIGGRAPH 2014, August 10 – 14, 2014, Vancouver, British Columbia, Canada.
2014 Copyright held by the Owner/Author.
ACM 978-1-4503-2961-3/14/08

H. Nii, K. Zhu, H. Yoshikawa, N. L. Htat, R. Aigner, R. Nakatsu,Fuwa-Vision: An auto-stereoscopic floating-image display,
SIGGRAPH Asia 2012 Emerging Technologies, pp. 1-4, 2012.