Virtual audiovisual technology has matured and its use in research is widely considered. However, the technology has yet to be established for speech- and audio-related perception research. This study examined the effects of different audiovisual conditions on head yaw and gaze direction when listening to multi-talker conversations. Two immersive displays were tested , a curved screen (CS) and a head-mounted display (HMD) , combined with three visual conditions (audio-only, virtual characters and video recordings) . Three groups of participants were tested: seventeen young normal-hearing, eleven older normal-hearing and ten older hearing-impaired  with hearing aids. Results showed that , when visual cues were not present, the participants tended to look ahead . When visual information was available, they looked at the target speaker. Significant differences between displays and visual conditions were found, pointing out that using different audiovisual setups might lead to slightly different head yaw and gaze direction . No significant differences were found between groups. An open interview showed that the CS was preferred over the HMD and that the video recordings were the favorite visual condition.
Virtual audiovisual technology has matured but the methodology has yet to be established for speech- and audio-related perception research. This study examined the effects of different audiovisual conditions on head yaw and gaze direction when listening to multi-talker conversations. Two immersive displays were tested and compared: a curved screen (CS) and a head-mounted display (HMD) . Using three visual conditions (audio-only, virtual characters and video recordings) , three groups of participants were tested: seventeen young normal-hearing, eleven older normal-hearing and ten older hearing-impaired listeners with hearing aids. The results showed that when there were no visual cues, participants tended to look ahead ; when visual information was available, they looked at the target speaker. Significant differences between displays and visual conditions were found, suggesting that using different audiovisual setups may lead to slightly different head yaw and gaze directions . No significant differences were found between groups. Open interviews showed that the CS was preferred over the HMD and that video recordings were the preferred visual condition.
R
and its use in research is widely considered. However, the technology
but the methodology
R
,
and compared:
R
, combined with
. Using
R
. Three
, three
A
listeners
R
Results showed that , when visual cues were not present, the
The results showed that when there were no visual cues,
R
. When
; when
R
pointing out
suggesting
R
might
may
R
direction
directions
R
An open interview
Open interviews
D
the
R
favorite
preferred