Social signals, their function, and automatic analysis: a survey

Vinciarelli, A. , Pantic, M., Bourlard, H. and Pentland, A. (2008) Social signals, their function, and automatic analysis: a survey. In: ICMI '08 Proceedings of the 10th International Conference on Multimodal Interfaces, Chania, Greece, October 20-22, 2008, pp. 61-68. (doi: 10.1145/1452392.1452405)

Full text not currently available from Enlighten.

Publisher's URL:


Social Signal Processing (SSP) aims at the analysis of social behaviour in both Human-Human and Human-Computer interactions. SSP revolves around automatic sensing and interpretation of social signals, complex aggregates of nonverbal behaviours through which individuals express their attitudes towards other human (and virtual) participants in the current social context. As such, SSP integrates both engineering (speech analysis, computer vision, etc.) and human sciences (social psychology, anthropology, etc.) as it requires multimodal and multidisciplinary approaches. As of today, SSP is still in its early infancy, but the domain is quickly developing, and a growing number of works is appearing in the literature. This paper provides an introduction to nonverbal behaviour involved in social signals and a survey of the main results obtained so far in SSP. It also outlines possibilities and challenges that SSP is expected to face in the next years if it is to reach its full maturity.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Vinciarelli, Professor Alessandro
Authors: Vinciarelli, A., Pantic, M., Bourlard, H., and Pentland, A.
College/School:College of Science and Engineering > School of Computing Science

University Staff: Request a correction | Enlighten Editors: Update this record