Interactive spatial sonification for non-visual exploration of virtual maps ?
We develop a multimodal interactive system for nonvisual exploration of virtual maps. Ecological and minimalistic principles guide customized binaural audio reproduction. Goal reaching and map reconstruction tasks assess contributions for each modality. The proximal haptic modality and the distal auditory modality are complementary. 3D auditory feedback improves performances with respect to 2D auditory feedback.
virtual maps multimodal interaction haptics 3d audio binaural sound non-visual navigation visual impairment multisensory integration haptic mouse