Action-based multisensory integration in striking events

Giordano, B.L., McAdams, S., Crosato, P., Avanzini, F., Casciato, C., Sinclair, S. and Wanderley, M.M. (2008) Action-based multisensory integration in striking events. Journal of the Acoustical Society of America, 123(5), p. 3178. (doi: 10.1121/1.2933270)

Abstract

Many theories of multisensory integration focus on action‐independent perception. This approach has limited ecological validity, because under everyday conditions we frequently act upon multisensory events through motor behavior. We present a novel methodology for the study of multisensory integration in action‐directed perception, focusing on striking events. Observers repeatedly hit a virtual object with a target striking velocity, and are presented with various types of sensory information about the striking event: auditory and̸or haptic and̸or visual. For each of the experimental trials, they initially receive feedback on the tracking of the target striking velocity. In a second phase, feedback is eliminated. In a third phase, the sensory properties of the striking event are changed. We quantify the extent to which a variation in each of the sensory modalities disrupts performance in the tracking of the target striking velocity. Multisensory dominance hierarchies are inferred from the comparison of the patterns of performance disruption in unimodal and multisensory contexts.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Giordano, Dr Bruno
• Authors: Giordano, B.L., McAdams, S., Crosato, P., Avanzini, F., Casciato, C., Sinclair, S., and Wanderley, M.M.
• College/School: College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
• Journal Name: Journal of the Acoustical Society of America
• ISSN: 0001-4966