Social signal processing: survey of an emerging domain

Vinciarelli, A. , Pantic, M. and Bourlard, H. (2009) Social signal processing: survey of an emerging domain. Image and Vision Computing, 27(12), pp. 1743-1759. (doi: 10.1016/j.imavis.2008.11.007)

Full text not currently available from Enlighten.

Publisher's URL:


The ability to understand and manage social signals of a person we are communicating with is the core of social intelligence. Social intelligence is a facet of human intelligence that has been argued to be indispensable and perhaps the most important for success in life. This paper argues that next-generation computing needs to include the essence of social intelligence – the ability to recognize human social signals and social behaviours like turn taking, politeness, and disagreement – in order to become more effective and more efficient. Although each one of us understands the importance of social signals in everyday life situations, and in spite of recent advances in machine analysis of relevant behavioural cues like blinks, smiles, crossed arms, laughter, and similar, design and development of automated systems for social signal processing (SSP) are rather difficult. This paper surveys the past efforts in solving these problems by a computer, it summarizes the relevant findings in social psychology, and it proposes a set of recommendations for enabling the development of the next generation of socially aware computing.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Vinciarelli, Professor Alessandro
Authors: Vinciarelli, A., Pantic, M., and Bourlard, H.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Image and Vision Computing
Publisher:Elsevier BV, North-Holland
ISSN (Online):1872-8138
Published Online:03 December 2008

University Staff: Request a correction | Enlighten Editors: Update this record