Multiple metaphors in metaphoric gesturing

Saund, C., Roth, M., Chollet, M. and Marsella, S. (2019) Multiple metaphors in metaphoric gesturing. 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), Cambridge, UK, 3-6 Sept 2019. pp. 524-530. ISBN 9781728138893 (doi: 10.1109/ACII.2019.8925435)

Full text not currently available from Enlighten.


The use of metaphoric gestures by speakers has long been known to influence thought in the viewer. What is less clear is the extent to which the expression of multiple metaphors in a single gesture reliably affect viewer interpretation. Additionally, gestures which express only one metaphor are not sufficient to explain the broad array of metaphoric gestures and metaphoric scenes that human speakers naturally produce. In this paper we address three issues related to the implementation of metaphoric gestures in virtual humans. First, we break down naturally occurring examples of multiple-metaphor gestures, as well as metaphoric scenes created by gesture sequences. Then, we show the importance of capturing multiple metaphoric aspects of gesture with a behavioral experiment using crowdsourced judgements of videos of alterations of the naturally occurring gestures. Finally, we discuss the challenges for computationally modeling metaphoric gestures that are raised by our findings.

Item Type:Conference or Workshop Item
Glasgow Author(s) Enlighten ID:Marsella, Professor Stacy and Chollet, Dr Mathieu and Roth, Ms Marion
Authors: Saund, C., Roth, M., Chollet, M., and Marsella, S.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience

University Staff: Request a correction | Enlighten Editors: Update this record