Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity

Kayser, S. J. and Kayser, C. (2018) Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports, 8, 3742. (doi: 10.1038/s41598-018-22137-8) (PMID:29487374) (PMCID:PMC5829215)

158802.pdf - Published Version
Available under License Creative Commons Attribution.



A well-known effect in multisensory perception is that congruent information received by different senses usually leads to faster and more accurate responses. Less well understood are trial-by-trial interactions, whereby the multisensory composition of stimuli experienced during previous trials shapes performance during a subsequent trial. We here exploit the analogy of multisensory paradigms with classical flanker tasks to investigate the neural correlates underlying trial-by-trial interactions of multisensory congruency. Studying an audio-visual motion task, we demonstrate that congruency benefits for accuracy and reaction times are reduced following an audio-visual incongruent compared to a congruent preceding trial. Using single trial analysis of motion-sensitive EEG components we then localize current-trial and serial interaction effects within distinct brain regions: while the multisensory congruency experienced during the current trial influences the encoding of task-relevant information in sensory-specific brain regions, the serial interaction arises from task-relevant processes within the inferior frontal lobe. These results highlight parallels between multisensory paradigms and classical flanker tasks and demonstrate a role of amodal association cortices in shaping perception based on the history of multisensory congruency.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Kayser, Dr Stephanie and Kayser, Professor Christoph
Authors: Kayser, S. J., and Kayser, C.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
Journal Name:Scientific Reports
Publisher:Nature Publishing Group
ISSN (Online):2045-2322
Copyright Holders:Copyright © 2018 The Authors
First Published:First published in Scientific Reports 8: 3742
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
670551DynaSensChristoph KayserEuropean Research Council (ERC)646657INP - CENTRE FOR COGNITIVE NEUROIMAGING