Decoupling Facial Expressions and Head Motions in Complex Emotions

Adams, A., Mahmoud, M. , Baltrušaitis, T. and Robinson, P. (2015) Decoupling Facial Expressions and Head Motions in Complex Emotions. In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi'an, China, 21-24 Sept 2015, pp. 274-280. ISBN 9781479999538 (doi: 10.1109/ACII.2015.7344583)

Abstract

Perception of emotion through facial expressions and head motion is of interest to both psychology and affective computing researchers. However, very little is known about the importance of each modality individually, as they are often treated together rather than separately. We present a study which isolates the effect of head motion from facial expression in the perception of complex emotions in videos. We demonstrate that head motions carry emotional information that is complementary rather than redundant to the emotion content in facial expressions. Finally, we show that emotional expressivity in head motion is not limited to nods and shakes and that additional gestures (such as head tilts, raises and general amount of motion) could be beneficial to automated recognition systems.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Mahmoud, Dr Marwa
• Authors: Adams, A., Mahmoud, M., Baltrušaitis, T., and Robinson, P.
• College/School: College of Science and Engineering > School of Computing Science
• ISSN: 2156-8111
• ISBN: 9781479999538