Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations

Kayser, S. J., Philiastides, M. G. and Kayser, C. (2017) Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations. NeuroImage, 148, pp. 31-41. (doi: 10.1016/j.neuroimage.2017.01.010) (PMID:28082107) (PMCID:PMC5349847)

133669.pdf - Published Version
Available under License Creative Commons Attribution.



Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Kayser, Dr Stephanie and Kayser, Professor Christoph and Philiastides, Professor Marios
Authors: Kayser, S. J., Philiastides, M. G., and Kayser, C.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
Journal Name:NeuroImage
ISSN (Online):1095-9572
Published Online:08 January 2017
Copyright Holders:Copyright © 2017 The Authors
First Published:First published in NeuroImage 148:31-41
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
670551DynaSensChristoph KayserEuropean Research Council (ERC)646657INP - CENTRE FOR COGNITIVE NEUROIMAGING
654411Neural correlates of learning and confidence during decision making and their utility in developing "intelligent technologies".Marios PhiliastidesEconomic & Social Research Council (ESRC)ES/L012995/1INP - CENTRE FOR COGNITIVE NEUROIMAGING
653861Spatiotemporal characterization of value judgments and reward processing in the human brainMarios PhiliastidesBiotechnology and Biological Sciences Research Council (BBSRC)BB/J015393/2INP - CENTRE FOR COGNITIVE NEUROIMAGING
658701Pathways and mechanisms underlying the visual enhancement of hearing in challenging environments.Christoph KayserBiotechnology and Biological Sciences Research Council (BBSRC)BB/L027534/1INP - CENTRE FOR COGNITIVE NEUROIMAGING