Audiovisual integration of emotional signals from others' social interactions

Piwek, L., Pollick, F. and Petrini, K. (2015) Audiovisual integration of emotional signals from others' social interactions. Frontiers in Psychology, 6, 611. (doi:10.3389/fpsyg.2015.00611) (PMID:26005430) (PMCID:PMC4424808)

[img]
Preview
Text
107181.pdf - Published Version
Available under License Creative Commons Attribution.

731kB

Abstract

Audiovisual perception of emotions has been typically examined using displays of a solitary character (e.g., the face-voice and/or body-sound of one actor). However, in real life humans often face more complex multisensory social situations, involving more than one person. Here we ask if the audiovisual facilitation in emotion recognition previously found in simpler social situations extends to more complex and ecological situations. Stimuli consisting of the biological motion and voice of two interacting agents were used in two experiments. In Experiment 1, participants were presented with visual, auditory, auditory filtered/noisy, and audiovisual congruent and incongruent clips. We asked participants to judge whether the two agents were interacting happily or angrily. In Experiment 2, another group of participants repeated the same task, as in Experiment 1, while trying to ignore either the visual or the auditory information. The findings from both experiments indicate that when the reliability of the auditory cue was decreased participants weighted more the visual cue in their emotional judgments. This in turn translated in increased emotion recognition accuracy for the multisensory condition. Our findings thus point to a common mechanism of multisensory integration of emotional signals irrespective of social stimulus complexity.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Pollick, Professor Frank
Authors: Piwek, L., Pollick, F., and Petrini, K.
College/School:College of Medical Veterinary and Life Sciences > Institute of Neuroscience and Psychology
Journal Name:Frontiers in Psychology
Publisher:Frontiers Research Foundation
ISSN:1664-1078
ISSN (Online):1664-1078
Copyright Holders:Copyright © 2015 The Authors
First Published:First published in Frontiers in Psychology 6:611
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record