Neural correlates of multisensory reliability and perceptual weights emerge at early latencies during audio-visual integration

Boyle, S. C. , Kayser, S. J. and Kayser, C. (2017) Neural correlates of multisensory reliability and perceptual weights emerge at early latencies during audio-visual integration. European Journal of Neuroscience, 46(10), pp. 2565-2577. (doi: 10.1111/ejn.13724) (PMID:28940728) (PMCID:PMC5725738)

[img] Text
148789.pdf - Published Version
Available under License Creative Commons Attribution.

0B

Abstract

To make accurate perceptual estimates observers must take the reliability of sensory information into account. Despite many behavioural studies showing that subjects weight individual sensory cues in proportion to their reliabilities, it is still unclear when during a trial neuronal responses are modulated by the reliability of sensory information, or when they reflect the perceptual weights attributed to each sensory input. We investigated these questions using a combination of psychophysics, EEG based neuroimaging, and single-trial decoding. Our results show that the weighted integration of sensory information in the brain is a dynamic process; effects of sensory reliability on task-relevant EEG components were evident 84ms after stimulus onset, while neural correlates of perceptual weights emerged 120ms after stimulus onset. These neural processes had different underlying sources, arising from sensory and parietal regions respectively. Together these results reveal the temporal dynamics of perceptual and neural audio-visual integration and support the notion of temporally early and functionally specific multisensory processes in the brain.

Item Type:Articles
Keywords:General neuroscience.
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Kayser, Professor Christoph and Boyle, Miss Stephanie and Kayser, Dr Stephanie
Authors: Boyle, S. C., Kayser, S. J., and Kayser, C.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
Journal Name:European Journal of Neuroscience
Publisher:Wiley
ISSN:0953-816X
ISSN (Online):1460-9568
Published Online:21 September 2017
Copyright Holders:Copyright © 2017 The Authors
First Published:First published in European Journal of Neuroscience 46(10):2565-2577
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
670551DynaSensChristoph KayserEuropean Research Council (ERC)646657INP - CENTRE FOR COGNITIVE NEUROIMAGING
658701Pathways and mechanisms underlying the visual enhancement of hearing in challenging environments.Christoph KayserBiotechnology and Biological Sciences Research Council (BBSRC)BB/L027534/1INP - CENTRE FOR COGNITIVE NEUROIMAGING