# Applying “Out of Body” Vibrotactile Illusion to Two-Finger Interaction for Perception of Object Dynamics

Jaedong Lee, Youngsun Kim, Gerard J. Kim

► To cite this version:

Jaedong Lee, Youngsun Kim, Gerard J. Kim. Applying “Out of Body” Vibrotactile Illusion to Two-Finger Interaction for Perception of Object Dynamics. 15th Human-Computer Interaction (INTER-ACT), Sep 2015, Bamberg, Germany. pp.506-509, 10.1007/978-3-319-22723-8_49. hal-01610851

HAL Id: hal-01610851

https://inria.hal.science/hal-01610851

Submitted on 5 Oct 2017

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Applying “Out of Body” Vibrotactile Illusion to Two-
Finger Interaction for Perception of Object Dynamics

Jaedong Lee, Youngsun Kim, Gerard J. Kim*

Digital Experience Laboratory, Korea University, Seoul, Korea

{jdlee, zyoko85, gjkim}@korea.ac.kr

**Abstract.** Vibrotactile feedback is an effective and economical approach for enriching interactive feedback. However, its effects are mostly limited to providing supplementary alarms or conveying the sense of simple object presence or contact. We propose to apply the “out of body” tactile illusion for selecting and manipulating a virtual moving object while also being able to feel its dynamics using two fingers. We assessed the user experience (focusing on the perception of the dynamics of the selected object) of the proposed method by comparing it to the conventional contact-based method. Our results indicate that users were able to perceive the dynamic feedback, and preferred it over the conventional method.

**Keywords:** Out-of-body illusion, Illusory tactile sensation, Pinch interaction, Vibrotactile interaction.

# 1 Introduction

Vibrotactile feedback is an effective and economical alternative to mechanically complex haptic devices. Despite its simplicity, it produces good results, especially when coordinated in a multimodal fashion with other associated feedback [1]. Still the effects are to mostly provide the sense of physical existence only. Therefore, it would be desirable for vibrotactile feedback to have the ability to express other aspects such as more dynamic interactions with objects (e.g., feeling a pulsating heart or holding on to a live animal). To achieve such a goal, we propose to apply an “out of body” tactile illusion. Funneling is one of the most notable illusory feedback techniques associated with vibrotactility [2]. Funneling can generate illusory tactile sensations by presenting two or more simultaneous tactile stimuli directly to two parts of the body. It is also possible to elicit a “moving” directional sensation by rendering successive funneling stimulations, which is also known as the “apparent movement” [3, 4]. Miyazaki et al. [5] discovered that a tactile illusion could be extended to “body connecting” objects and that it could create illusory sensations that from “out of the body,” e.g. as if coming from an object that is external to the user’s body.

Based on these illusion phenomena, we propose a two finger interaction method where two fingers “pinch” an object, and two vibration motors attached to the two tips

<footnote>* Corresponding author</footnote>
of the fingers convey tactile touch/contact and directional object dynamics (see Figure 1). The proposed method is comparatively assessed for its user experience (focusing on the perception of the dynamics of the object) through a user experiment.

## 2 Related Work

The mechanism most commonly used to generate hand-held tactile/haptic feedback has been employing small vibrating motors. These have been mostly used with mobile devices or hand-held game controllers to provide supplementary feedback for various interaction events (e.g., alarm, touch/key input, and virtual collision). Researchers have searched for ways to simulate other types of information by controlling the vibrating signal (e.g., texture simulation) [6] and by combining it with other modalities [7]. Nevertheless, vibrating motors are still inherently limited in terms of their ability to convey true haptic force, i.e., rigid contact as well as directional or inertial effects. Piezo-electric materials are another popular technology that is used for tactile feedback for mobile and hand-held devices [8, 9]. However, while this method is able to recreate static surface textures, e.g., protrusions and bumps, the devices lack features to provide more dynamic feedback.

A number of researchers have applied tactile illusion techniques to human interfaces [3, 4, 7, 10, 11] e.g. to minimize the number of tactile actuators (instead of using a comparable tactile array) [7] or to design vibrotactile feedback method that do not require direct contact to the fingers/hands. However, most of the prior tactile interactions have focused only on the providing feedback to indicate an existence of an object, the perception of texture patterns, and the outer shape of the object rather than its dynamics. In addition, illusion techniques have been usually applied to a continuous skin area rather than external to the body. Thus, applying the out of body tactile illusion seems one promising way to enrich the feedback while improving the general usability.

## 3 Experiment: Perception of Dynamics by Out of Body Tactile Illusion in Two-finger Interaction

### 3.1 Experimental Set-up and Procedure

We demonstrate an application of “out of body” tactile illusion for two-finger object selection and manipulation and experimentally assesses whether the proposed method can bring about an improved user experience, when compared to conventional methods, by providing tangibility and sensation of the object and its interaction dynamics. Fourteen paid subjects, 10 men and 4 women with a mean age of 25, participated in the experiment.

An experiment with one-factor (3 feedback methods) within-subject with repeated measures was conducted. The task was to pick and hold a moving object (an animated fly) (Figure 1). Both fingers were tracked using the Leap Motion sensor, and two conventional methods with no vibrotactile feedback (NF) and contact-only feedback (CF, nominal vibration given only for indicating contact with fingers) were compared
to the proposed method (TI) where tactile illusion rendering was applied to the fingertips. No quantitative performance was measured, and only a questionnaire of the user's experience was filled out (for the questionnaire categories, see Figure 2).

<figure><img src="image_2.png" /><figcaption>**Fig. 1.** The proposed vibrotactile illusion based interaction method for holding a moving object and feeling for its dynamics (left), and its experimental implementation (right).</figcaption></figure>

## 3.2 Results

Figure 2 shows the average responses to the seven UX survey questions and the differences among the three feedback methods. In most categories (except for the “Fatigue” category), it is quite clear that the proposed method (TI) exhibited a much more positive user experience. Obviously, the NF condition scored the least in all UX categories. In fact, the Kruskal-Wallis test (non-parametric analysis) revealed that there existed statistically significant differences in all categories except for Q6 (Fatigue). A Tukey test using Ranks post-hoc analysis showed that the proposed method had statistically significant effects over the NF and CF.

Note that to convey the feelings of object dynamics, providing only contact feedback (CF) at the respective fingertips would not be sufficient because the object may be moving at the mid-location without direct contact with the fingertips. The subjects also showed an overwhelming preference for the proposed method (TI) (out of 14 subjects, 13 for task). In summary, the experiment demonstrated that the interaction experience can be significantly improved through the proposed tactile illusion based rendering of the interaction object dynamics.

# 4 Discussion and Conclusion

In this paper, we have presented the possibility of applying an “out of body” tactile illusion to a two-finger object interaction in order to improve the user experience without causing significant fatigue. We strongly argue that the proposed tactile rendering of the object dynamics (and not just a multimodal fusion) was the contributing factor to the improvement in the interaction experience. The proposed method can be applied to many other interactive tasks, such as in tangible manipulation of augmented objects, interacting with holographic/stereoscopic virtual objects, surface computing, etc. Our future work will continue to develop and apply other illusion based techniques (including saltation) in a similar manner. One disadvantage of the proposed method is in its wearability. We are investigating whether the vibrators can be positioned and worn like a ring with similar effects.
<figure><img src="image_3.png" /><figcaption>**Fig. 2.** Responses to the UX questionnaire for and differences among the three feedback methods (the error bars indicate the standard error of the mean).</figcaption></figure>

## Acknowledgement

This research was supported by Basic Science Research Program (No. 2011-0030079) and International Research & Development Program (Grant number: 2014K1A3A1A17073365) through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning

## References

1. Linjama, J., Kaaresoja, T.: Novel, minimalist haptic gesture interaction for mobile devices. In: Third Nordic conference on Human-computer interaction, pp. 457-458. ACM, (2004)

2. Alles, D. S.: Information transmission by phantom sensations. Man-Machine Systems, IEEE Transactions on. 11(1), 85-91 (1970)

3. Israr, A., Poupyrev, I.: Tactile brush: drawing on skin with a tactile grid display. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 2019-2028. (2011)

4. Seo, J., Choi, S.: Initial study for creating linearly moving vibrotactile sensation on mobile device. In: Haptics Symposium, pp. 67-70. IEEE, (2010)

5. Miyazaki, M., Hirashima, M., Nozaki, D.: The “cutaneous rabbit” hopping out of the body. J. Neuroscience. 30(5), 1856-1860 (2010)

6. Okamura, A. M., Dennerlein, J. T., Howe, R. D.: Vibration feedback models for virtual environments. In: IEEE International Conference on Robotics and Automation, pp. 674-679. IEEE, (1998)

7. Hoggan, E., Anwar, S., Brewster, S. A.: Mobile multi-actuator tactile displays. In: Oakley, I., Brewster, S. (eds.) Haptic and audio interaction design 2007. LNCS, vol. 4813, pp. 22-33. Springer, Heidelberg (2007)

8. Poupyrev, I., Maruyama, S., Rekimoto, J.: Ambient touch: designing tactile interfaces for handheld devices. In: 15th annual ACM symposium on User interface software and technology, pp. 51-60. ACM, (2002)

9. Chubb, E. C., Colgate, J. E., Peshkin, M. A.: Shiverpad: A glass haptic surface that produces shear force on a bare finger. Haptics, IEEE Transactions on, 3(3), 189-198 (2010)

10. Mizukami, Y., Sawada, H.: Tactile information transmission by apparent movement phenomenon using shape-memory alloy device. Int. J. Disability and Human Development, 5(3), 277-284 (2006)

11. Ooka, T., Fujita, K.: Virtual object manipulation system with substitutive display of tangential force and slip by control of vibrotactile phantom sensation. In: IEEE Haptics Symposium, pp. 215-218. IEEE, (2010)