Crossmodal adaptation in right posterior superior temporal sulcus during face-voice emotional integration

Watson, R., Latinus, M., Noguchi, T., Garrod, O., Crabbe, F. and Belin, P. (2014) Crossmodal adaptation in right posterior superior temporal sulcus during face-voice emotional integration. Journal of Neuroscience, 34(20), pp. 6813-6821. (doi: 10.1523/JNEUROSCI.4478-13.2014)

Full text not currently available from Enlighten.

Abstract

The integration of emotional information from the face and voice of other persons is known to be mediated by a number of “multisensory” cerebral regions, such as the right posterior superior temporal sulcus (pSTS). However, whether multimodal integration in these regions is attributable to interleaved populations of unisensory neurons responding to face or voice or rather by multimodal neurons receiving input from the two modalities is not fully clear. Here, we examine this question using functional magnetic resonance adaptation and dynamic audiovisual stimuli in which emotional information was manipulated parametrically and independently in the face and voice via morphing between angry and happy expressions. Healthy human adult subjects were scanned while performing a happy/angry emotion categorization task on a series of such stimuli included in a fast event-related, continuous carryover design. Subjects integrated both face and voice information when categorizing emotion—although there was a greater weighting of face information—and showed behavioral adaptation effects both within and across modality. Adaptation also occurred at the neural level: in addition to modality-specific adaptation in visual and auditory cortices, we observed for the first time a crossmodal adaptation effect. Specifically, fMRI signal in the right pSTS was reduced in response to a stimulus in which facial emotion was similar to the vocal emotion of the preceding stimulus. These results suggest that the integration of emotional information from face and voice in the pSTS involves a detectable proportion of bimodal neurons that combine inputs from visual and auditory cortices.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Garrod, Dr Oliver and Watson, Miss Rebecca and Belin, Professor Pascal and Noguchi, Mr Takao and Crabbe, Mrs Frances and Latinus, Dr Marianne
Authors: Watson, R., Latinus, M., Noguchi, T., Garrod, O., Crabbe, F., and Belin, P.
College/School:College of Science and Engineering > School of Psychology
College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
Journal Name:Journal of Neuroscience
Publisher:The Society for Neuroscience
ISSN:0270-6474
ISSN (Online):1529-2401

University Staff: Request a correction | Enlighten Editors: Update this record