A demonstration of the perception system in SimSensei, a virtual human application for healthcare interviews

Stratou, G. et al. (2015) A demonstration of the perception system in SimSensei, a virtual human application for healthcare interviews. In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi'an, China, 21-24 Sept 2015, pp. 787-789. ISBN 9781479999538 (doi: 10.1109/ACII.2015.7344661)

Abstract

We present the SimSensei system, a fully automatic virtual agent that conducts interviews to assess indicators of psychological distress. With this demo, we focus our attention on the perception part of the system, a multimodal framework which captures and analyzes user state behavior for both behavioral understanding and interactional purposes. We will demonstrate real-time user state sensing as a part of the SimSensei architecture and discuss how this technology enabled automatic analysis of behaviors related to psychological distress.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Marsella, Professor Stacy
• Authors: Stratou, G., Morency, L.-P., DeVault, D., Hartholt, A., Fast, E., Lhommet, M., Lucas, G., Morbini, F., Georgila, K., Scherer, S., Gratch, J., Marsella, S., Traum, D., and Rizzo, A.
• College/School: College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
• ISBN: 9781479999538