Interpreting hand-over-face gestures

Mahmoud, M. and Robinson, P. (2011) Interpreting hand-over-face gestures. In: D'Mello, S., Graesser, A., Schuller, B. and Martin, J.-C. (eds.) Affective Computing and Intelligent Interaction: 4th International Conference, ACII 2011, Memphis, TN, USA, October 9–12, 2011, Proceedings, Part II. Series: Lecture notes in computer science (6975). Springer: Berlin, Heidelberg, pp. 248-255. ISBN 9783642245701 (doi: 10.1007/978-3-642-24571-8)

Full text not currently available from Enlighten.


People often hold their hands near their faces as a gesture in natural conversation, which can interfere with affective inference from facial expressions. However, these gestures are valuable as an additional channel for multi-modal inference. We analyse hand-over-face gestures in a corpus of naturalistic labelled expressions and propose the use of those gestures as a novel affect cue for automatic inference of cognitive mental states. We define three hand cues for encoding hand-over-face gestures, namely hand shape, hand action and facial region occluded, serving as a first step in automating the interpretation process.

Item Type:Book Sections
Glasgow Author(s) Enlighten ID:Mahmoud, Dr Marwa
Authors: Mahmoud, M., and Robinson, P.
College/School:College of Science and Engineering > School of Computing Science

University Staff: Request a correction | Enlighten Editors: Update this record