Shared and modality-specific brain regions that mediate auditory and visual word comprehension

Keitel, A. , Gross, J. and Kayser, C. (2020) Shared and modality-specific brain regions that mediate auditory and visual word comprehension. eLife, 9, e56972. (doi: 10.7554/elife.56972) (PMID:32831168) (PMCID:PMC7470824)

[img] Text
225561.pdf - Published Version
Available under License Creative Commons Attribution.

2MB

Abstract

Visual speech carried by lip movements is an integral part of communication. Yet, it remains unclear in how far visual and acoustic speech comprehension are mediated by the same brain regions. Using multivariate classification of full-brain MEG data, we first probed where the brain represents acoustically and visually conveyed word identities. We then tested where these sensory-driven representations are predictive of participants’ trial-wise comprehension. The comprehension-relevant representations of auditory and visual speech converged only in anterior angular and inferior frontal regions and were spatially dissociated from those representations that best reflected the sensory-driven word identity. These results provide a neural explanation for the behavioural dissociation of acoustic and visual speech comprehension and suggest that cerebral representations encoding word identities may be more modality-specific than often upheld.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Kayser, Professor Christoph and Gross, Professor Joachim and Keitel, Dr Anne
Creator Roles:
Keitel, A.Conceptualization, Resources, Formal analysis, Validation, Investigation, Visualization, Methodology, Writing – original draft, Writing – review and editing
Gross, J.Supervision, Funding acquisition, Writing – original draft, Writing – review and editing
Kayser, C.Conceptualization, Resources, Formal analysis, Supervision, Funding acquisition, Investigation, Visualization, Methodology, Writing – original draft, Writing – review and editing
Authors: Keitel, A., Gross, J., and Kayser, C.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
Journal Name:eLife
Publisher:eLife Sciences Publications
ISSN:2050-084X
ISSN (Online):2050-084X
Copyright Holders:Copyright © 2020 Keitel et al.
First Published:First published in eLife 9: e56972
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
170507Pathways and mechanisms underlying the visual enhancement of hearing in challenging environments.Philippe SchynsBiotechnology and Biological Sciences Research Council (BBSRC)BB/L027534/1NP - Centre for Cognitive Neuroimaging (CCNi)
172114DynaSensChristoph KayserEuropean Research Council (ERC)646657NP - Centre for Cognitive Neuroimaging (CCNi)
167204Natural and modulated neural communication: State-dependent decoding and driving of human Brain Oscillations.Joachim GrossWellcome Trust (WELLCOTR)098433/Z/12/ZNP - Centre for Cognitive Neuroimaging (CCNi)