Crossmodal integration with a head-mounted display and auditory display options: is there cause for concern?

TL;DRAbstract

Head-Mounted Displays (HMDs) are increasingly used to support mobile work (Laramee & Ware, 2002). Human operators sometimes require additional auditory support when using an HMD, which raises the question of whether sound is better delivered publicly in free-field or privately via earpiece. A novel experimental procedure was created in which participants had to identify mismatches between auditory information and visual information on an HMD. Different conditions of sound delivery and physical movement were manipulated within-subjects. Participants heard the sound either via earpiece or free-field while they either sat or moved about the test room. Predictions were based on the idea that inconsistent spatial mapping of vision and sound would compromise mismatch detection. First, I predicted a main effect of movement such that participants‟ mismatch detection would be worse when they moved than when they sat. Second, I predicted an interaction between movement and sound delivery. When p

Chat with Paper

AI Agents for this Paper