Social signal processing: the research agenda

Pantic, M., Cowie, R., D'Errico, F., Heylen, D.,, Mehu, M., Pelachaud, P., Poggi, I., Schroeder, M. and Vinciarelli, A. (2011) Social signal processing: the research agenda. In: Moeslund, T.B., Hilton, A., Krueger, V. and Sigal, L. (eds.) Visual Analysis of Humans: Looking at People. Springer Verlag (Germany), pp. 511-538. ISBN 9780857299970 (doi: 10.1007/978-0-85729-997-0_26)

Full text not currently available from Enlighten.

Publisher's URL:


The exploration of how we react to the world and interact with it and each other remains one of the greatest scientific challenges. Latest research trends in cognitive sciences argue that our common view of intelligence is too narrow, ignoring a crucial range of abilities that matter immensely for how people do in life. This range of abilities is called social intelligence and includes the ability to express and recognise social signals produced during social interactions like agreement, politeness, empathy, friendliness, conflict, etc., coupled with the ability to manage them in order to get along well with others while winning their cooperation. Social Signal Processing (SSP) is the new research domain that aims at understanding and modelling social interactions (human-science goals), and at providing computers with similar abilities in human–computer interaction scenarios (technological goals). SSP is in its infancy, and the journey towards artificial social intelligence and socially aware computing is still long. This research agenda is twofold, a discussion about how the field is understood by people who are currently active in it and a discussion about issues that the researchers in this formative field face.

Item Type:Book Sections
Glasgow Author(s) Enlighten ID:Vinciarelli, Professor Alessandro
Authors: Pantic, M., Cowie, R., D'Errico, F., Heylen, D.,, Mehu, M., Pelachaud, P., Poggi, I., Schroeder, M., and Vinciarelli, A.
College/School:College of Science and Engineering > School of Computing Science
Publisher:Springer Verlag (Germany)

University Staff: Request a correction | Enlighten Editors: Update this record