Visual capture of a stereo sound: Interactions between cue reliability, sound localization variability, and cross-modal bias

Christopher Montagne; Yi Zhou

doi:10.1121/1.4955314

Visual capture of a stereo sound: Interactions between cue reliability, sound localization variability, and cross-modal bias

The Journal of the Acoustical Society of America ◽

10.1121/1.4955314 ◽

2016 ◽

Vol 140 (1) ◽

pp. 471-485 ◽

Cited By ~ 3

Author(s):

Christopher Montagne ◽

Yi Zhou

Keyword(s):

Sound Localization ◽

Visual Capture ◽

Cue Reliability

Download Full-text

The Effects of Cue Reliability on Crossmodal Recalibration in Adults and Children

Multisensory Research ◽

10.1163/22134808-bja10053 ◽

2021 ◽

pp. 1-19

Author(s):

Sophie Rohlf ◽

Patrick Bruns ◽

Brigitte Röder

Keyword(s):

Multisensory Integration ◽

Sound Localization ◽

Visual Stimulus ◽

Cue Combination ◽

Single Exposure ◽

Visual Cue ◽

Cue Reliability ◽

Adults And Children ◽

Ventriloquist Effect

Abstract Reliability-based cue combination is a hallmark of multisensory integration, while the role of cue reliability for crossmodal recalibration is less understood. The present study investigated whether visual cue reliability affects audiovisual recalibration in adults and children. Participants had to localize sounds, which were presented either alone or in combination with a spatially discrepant high- or low-reliability visual stimulus. In a previous study we had shown that the ventriloquist effect (indicating multisensory integration) was overall larger in the children groups and that the shift in sound localization toward the spatially discrepant visual stimulus decreased with visual cue reliability in all groups. The present study replicated the onset of the immediate ventriloquist aftereffect (a shift in unimodal sound localization following a single exposure of a spatially discrepant audiovisual stimulus) at the age of 6–7 years. In adults the immediate ventriloquist aftereffect depended on visual cue reliability, whereas the cumulative ventriloquist aftereffect (reflecting the audiovisual spatial discrepancies over the complete experiment) did not. In 6–7-year-olds the immediate ventriloquist aftereffect was independent of visual cue reliability. The present results are compatible with the idea of immediate and cumulative crossmodal recalibrations being dissociable processes and that the immediate ventriloquist aftereffect is more closely related to genuine multisensory integration.

Download Full-text