3D corpus of spontaneous complex mental states

Mahmoud, M. , Baltrušaitis, T., Robinson, P. and Riek, L. D. (2011) 3D corpus of spontaneous complex mental states. In: D'Mello, S., Graesser, A., Schuller, B. and Martin, J.-C. (eds.) Affective Computing and Intelligent Interaction: 4th International Conference, ACII 2011, Memphis, TN, USA, October 9–12, 2011, Proceedings, Part I. Series: Lecture notes in computer science (6874). Springer: Berlin, Heidelberg, pp. 205-214. ISBN 9783642245992 (doi: 10.1007/978-3-642-24600-5_24)

Abstract

Hand-over-face gestures, a subset of emotional body language, are overlooked by automatic affect inference systems. We propose the use of hand-over-face gestures as a novel affect cue for automatic inference of cognitive mental states. Moreover, affect recognition systems rely on the existence of publicly available datasets, often the approach is only as good as the data. We present the collection and annotation methodology of a 3D multimodal corpus of 108 audio/video segments of natural complex mental states. The corpus includes spontaneous facial expressions and hand gestures labelled using crowd-sourcing and is publicly available.

• Item Type: Book Sections
• Status: Published
• Glasgow Author(s) Enlighten ID: Mahmoud, Dr Marwa
• Authors: Mahmoud, M., Baltrušaitis, T., Robinson, P., and Riek, L. D.
• College/School: College of Science and Engineering > School of Computing Science
• Publisher: Springer
• ISBN: 9783642245992