Automatic audiovisual behavior descriptors for psychological disorder analysis

Scherer, S., Stratou, G., Lucas, G., Mahmoud, M. , Boberg, J., Gratch, J., Rizzo, A. (S.) and Morency, L.-P. (2014) Automatic audiovisual behavior descriptors for psychological disorder analysis. Image and Vision Computing, 32(10), pp. 648-658. (doi: 10.1016/j.imavis.2014.06.001)

Full text not currently available from Enlighten.

Abstract

We investigate the capabilities of automatic audiovisual nonverbal behavior descriptors to identify indicators of psychological disorders such as depression, anxiety, and post-traumatic stress disorder. Due to strong correlations between these disordersas measured with standard self-assessment questionnaires in this study, we focus our investigations in particular on a generic distress measure as identified using factor analysis. Within this work, we seek to confirm and enrich present state of the art, predominantly based on qualitative manual annotations, with automatic quantitative behavior descriptors. We propose a number of nonverbal behavior descriptors that can be automatically estimated from audiovisual signals. Such automatic behavior descriptors could be used to support healthcare providers with quantified and objective observations that could ultimately improve clinical assessment. We evaluate our work on the dataset called the Distress Assessment Interview Corpus (DAIC) which comprises dyadic interactions between a confederate interviewer and a paid participant. Our evaluation on this dataset shows correlation of our automatic behavior descriptors with the derived general distress measure. Our analysis also includes a deeper study of self-adaptor and fidgeting behaviors based on detailed annotations of where these behaviors occur.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Mahmoud, Dr Marwa
Authors: Scherer, S., Stratou, G., Lucas, G., Mahmoud, M., Boberg, J., Gratch, J., Rizzo, A. (S.), and Morency, L.-P.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Image and Vision Computing
Publisher:Elsevier
ISSN:0262-8856
ISSN (Online):1872-8138
Published Online:20 June 2014

University Staff: Request a correction | Enlighten Editors: Update this record