Giordano, B. L., Ince, R. A.A. , Gross, J. , Schyns, P. G. , Panzeri, S. and Kayser, C. (2017) Contributions of local speech encoding and functional connectivity to audio-visual speech perception. eLife, 6, e24763. (doi: 10.7554/elife.24763) (PMID:28590903) (PMCID:PMC5462535)
|
Text
142077.pdf - Published Version Available under License Creative Commons Attribution. 1MB |
Abstract
Seeing a speaker’s face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker’s face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.
| Item Type: | Articles |
|---|---|
| Status: | Published |
| Refereed: | Yes |
| Glasgow Author(s) Enlighten ID: | Kayser, Professor Christoph and Gross, Professor Joachim and Schyns, Professor Philippe and Giordano, Dr Bruno and Panzeri, Professor Stefano and Ince, Dr Robin |
| Creator Roles: | Panzeri, S.Conceptualization, Methodology, Writing – review and editing Kayser, C.Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review and editing Giordano, B.Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review and editing Gross, J.Funding acquisition, Methodology, Writing – review and editing Ince, R.Methodology, Resources, Software, Writing – review and editing Schyns, P.Methodology, Writing – review and editing |
| Authors: | Giordano, B. L., Ince, R. A.A., Gross, J., Schyns, P. G., Panzeri, S., and Kayser, C. |
| College/School: | College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience |
| Journal Name: | eLife |
| Publisher: | eLife Sciences Publications |
| ISSN: | 2050-084X |
| ISSN (Online): | 2050-084X |
| Copyright Holders: | Copyright © 2017 Giordano et al. |
| First Published: | First published in eLife 6: e24763 |
| Publisher Policy: | Reproduced under a Creative Commons license |
University Staff: Request a correction | Enlighten Editors: Update this record
Funder and Project Information
Funder and Project Information