Facial expressions of emotion include iconic signals of rejection and acceptance

Nölle, J., Chen, C. , Hensel, L. B., Garrod, O. G.B., Schyns, P. G. and Jack, R. E. (2021) Facial expressions of emotion include iconic signals of rejection and acceptance. Journal of Vision, 21(9), p. 2932. (doi: 10.1167/jov.21.9.2932)

Full text not currently available from Enlighten.

Abstract

What are the evolutionary origins of facial expressions? One theory posits that they evolved from facial movements that control sensory stimulation (e.g., closing eyes to reduce visual input). Such signals would afford a salient iconicity that could facilitate communication. Here, we examined whether facial expressions of emotion include expansion and contraction facial movements that serve as icons of rejection and acceptance. Using the data-driven method of reverse correlation, we first modelled dynamic facial expressions of the six classic emotions – happy, surprise, fear, disgust, anger and sad – in each of 60 participants (Western, 31 females). On each of 2400 experimental trials, participants categorized a facial animation comprising a randomly activated subset of individual facial movements (Action Units; AUs) according to the six classic emotions or ‘other.’ We then modelled the dynamic AUs associated with each participant’s emotion response using non-parametric permutation inference (p < 0.05), resulting in 360 dynamic facial expression models (60 participants X 6 emotions). Next, we identified in each facial expression model, iconic facial movements and found that expansion movements – e.g., brow raising (AU1-2), eye opening (AU5), nostril dilating (AU38) and mouth gaping (AU26) – are primarily associated with acceptance messages (e.g., happy, surprise). Contraction movements – e.g., brow lowering (AU4), wincing (AU7), nose wrinkling (AU9), lip pinching (AU23) – are primarily associated with rejection messages (e.g., fear, disgust, anger, sad). Finally, we replicated these results with a separate set of facial expressions of conversational messages – thinking, interested, bored and confused (20 Westerners, 10 females). Together, our results show that facial expressions comprise latent iconic facial signals that represent rejection or acceptance in line with their social function. Future research will address how this iconicity could be exapted to ground more complex and abstract meanings in multimodal face-to-face communication.

Item Type:Articles
Additional Information:Vision Sciences Society Annual Meeting Abstract (V-VSS 2021), 21-26 May 2021.
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Garrod, Dr Oliver and Hensel, Laura and Noelle, Dr Jonas and Jack, Professor Rachael and Chen, Dr Chaona and Schyns, Professor Philippe
Authors: Nölle, J., Chen, C., Hensel, L. B., Garrod, O. G.B., Schyns, P. G., and Jack, R. E.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
Journal Name:Journal of Vision
Publisher:Association for Research in Vision and Ophthalmology
ISSN:1534-7362
ISSN (Online):1534-7362

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
304001Computing the Face Syntax of Social CommunicationRachael JackEuropean Research Council (ERC)759796Psychology
190558Mapping the Cultural Landscape of Emotions for Social InteractionRachael JackEconomic and Social Research Council (ESRC)ES/K001973/1Psychology
303166Scottish Graduate School Science Doctoral Training Partnership (DTP)Mary Beth KneafseyEconomic and Social Research Council (ESRC)ES/P000681/1SS - Academic & Student Administration
172046Visual Commonsense for Scene UnderstandingPhilippe SchynsEngineering and Physical Sciences Research Council (EPSRC)EP/N019261/1Centre for Cognitive Neuroimaging
172413Brain Algorithmics: Reverse Engineering Dynamic Information Processing Networks from MEG time seriesPhilippe SchynsWellcome Trust (WELLCOTR)107802/Z/15/ZCentre for Cognitive Neuroimaging