Social innovation
Human interface, Design, Usability

Human factors research on visual information presentation
using augmented reality
Graduate School of Human Sciences
Professor Kazumitsu Shinohara
https://researchmap.jp/read0042846

Abstract
Visual information presentation using artificial reality (AR), in
which artificially generated images are superimposed in the realworld, is becoming widely used as a visual interface for varioustasks. On the other hand, how the use of such information presentation relates to users’ attention and cognition has not been fully
investigated. In this study, we proposed a monocular presentation
method in which an artificially generated image is presented to asingle eye and a method in which the presentation of visual information follows the position of the work object and investigated theuser’s attention and cognition when these methods are used, using
cognitive psychology experimental techniques.

▍ Background & Results

Social innovation

Visual information presentation using augmented reality (AR)is expected to expand its range of applications to a wide variety of tasks. It is necessary for users to improve AR presentation
methods to better match human characteristics. In addition, futuretechnological developments may lead to the appearance of newpresentation methods that did not exist in the past, which may
cause human factors problems. This is a research issue where engineering technology development and research on user behavior
and psychological characteristics should work closely together.
Visual information presentation using augmented reality (AR)is expected to expand its range of applications to a wide varietyof tasks. It is necessary to improve visual AR presentation methods that are compatible with human characteristics and improvevisual information presentation to make it easier for users to use.
In addition, future technological developments may lead to theemergence of new presentation methods that have not existed in
the past, which may cause problems related to the human factor of
the user. This is a research subject where engineering technology
development and research on user behavior and psychologicalcharacteristics should work closely together.

formance on a task was higher when monocular presentation wasused. In addition, a study using the “change oversight” task, which
is often used as an experimental test of visual selective attention incognitive psychology, showed that change oversight did not occur
when a monocular presentation was used. In addition, an investigation using electroencephalography (EEG) measurements wasconducted to determine the perceptual and cognitive mechanisms
underlying the significance of monocular presentation (Fig.3), andit was shown that monocular presentation may attenuate information processing in the cognitive stage.
In AR information presentation, the presentation position of artificial images also affects work efficiency. In particular, it is desirable
for information to be presented close to the work object in real
space in work situations where the user proceeds with the workin real space while referring to the necessary information. In anexperiment using a visual search task to find a specified object,
we found that when the information on the object to be searched
was allowed to move freely within the search space, the task performance was higher, and the mental strain was rated lower than in
the condition where the information on the object to be searched
was always displayed in the same place.

Fig.1 Monocular AR information presentation▍ Significance of the research and Future perspective

Visual augmented reality (AR) information presentation, in which
artificial images are superimposed on top of the real space using
a heads-up display or similar device and made simultaneously visible, can efficiently present a variety of visual information to users
without requiring them to make large eye movements. On the other
hand, there is a possibility that artificial images may be difficult tosee because they are presented at a different distance from thereal space, or that artificial images may interfere with the visual
perception required in the real space.
As a solution to this problem, a method was proposed in which
artificial images are presented only to a single eye (Fig.1). It wasexpected that the monocular presentation would reduce the unnaturalness of the artificial images during viewing by blurring theperceived distance of the artificial images, and that the artificialimages would not be presented to one eye, thus reducing thepossibility that the artificial images would interfere with the perception of real space. An experimental system (Fig.2) combining asemi-transparent mirror and a polarization filter was created to realize monocular presentation in augmented reality, and experiments
comparing binocular and monocular presentation showed that per-Fig.2 Experiment system

Fig.3 Hypothetical model of cognitive process when using binocular or monocularAR presentation

P a t e n t
Kitamura, Akihiko; Naito, Hiroshi; Kimura, Takahiko et al. Comparison between Binocular and Monocular Augmented Reality Presentation in a Tracing Task.
Journal of the Institute of Image Information and Television Engineers. 2015, 69(10), p. J292-J297. doi: 10.3169/itej.69.J292
Fujiwara, Yushi; Shinohara, Kazumitsu; Kitamura, Akihiko et al. The effect of visual support information tracking presentation on task performance andworkload. The Japanese Journal of Ergonomics. 2019, 55(3), p67-73. (in Japanese)
Tr e a t i s e
Kitamura, Akihiko; Kinosada, Yasunori; Shinohara, Kazumitsu. Monocular Presentation Attenuates Change Blindness During the Use of Augmented Reality.
Frontiers in Psychology. 2019, 10: 1688, doi: 10.3389/fpsyg.2019.01688
Dempo, Akihiko; Kimura, Tsukasa; Shinohara, Kazumitsu. Perceptual and cognitive processes in augmented reality – comparison between binocular andmonocular presentations. Attention, Perception, and Psychophysics. 2021, 84, p.490-508. doi: 10.3758/s13414-021-02346-6
UR
L https://acpsy.hus.osaka-u.ac.jp/
K e y w o r d artificial reality, information display, attention, cognitive psychology, human factors