Automatic Behavior Descriptors for Psychological Disorder Analysis

Scherer, S., Stratou, G., Mahmoud, M. , Boberg, J., Gratch, J., Rizzo, A. and Morency, L.-P. (2013) Automatic Behavior Descriptors for Psychological Disorder Analysis. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China, 22-26 Apr 2013, ISBN 9781467355469 (doi: 10.1109/FG.2013.6553789)

Full text not currently available from Enlighten.


We investigate the capabilities of automatic nonverbal behavior descriptors to identify indicators of psychological disorders such as depression, anxiety, and post-traumatic stress disorder. We seek to confirm and enrich present state of the art, predominantly based on qualitative manual annotations, with automatic quantitative behavior descriptors. In this paper, we propose four nonverbal behavior descriptors that can be automatically estimated from visual signals. We introduce a new dataset called the Distress Assessment Interview Corpus (DAIC) which includes 167 dyadic interactions between a confederate interviewer and a paid participant. Our evaluation on this dataset shows correlation of our automatic behavior descriptors with specific psychological disorders as well as a generic distress measure. Our analysis also includes a deeper study of self-adaptor and fidgeting behaviors based on detailed annotations of where these behaviors occur.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Mahmoud, Dr Marwa
Authors: Scherer, S., Stratou, G., Mahmoud, M., Boberg, J., Gratch, J., Rizzo, A., and Morency, L.-P.
College/School:College of Science and Engineering > School of Computing Science
Published Online:15 July 2013

University Staff: Request a correction | Enlighten Editors: Update this record