NADiA - Towards Neural Network Driven Virtual Human Conversation Agents

Wu, J., Ghosh, S., Chollet, M. , Ly, S., Mozgai, S. and Scherer, S. (2018) NADiA - Towards Neural Network Driven Virtual Human Conversation Agents. In: 17th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2018), Stockholm, Sweden, 10-15 Jul 2018, pp. 2262-2264. ISBN 9781510868083

Abstract

Advances in artificial intelligence and machine learning - in particular neural networks - have given rise to a new generation of virtual assistants and chatbots. Within this work, we describe the motivation and architecture of NADiA - Neurally Animated Dialog Agent - which leverages both the user's verbal input and facial expressions for multi-modal conversation. NADiA combines a neural language model that generates conversational responses, a convolutional neural network for facial expression analysis, and virtual human technology that is deployed on a mobile phone.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Chollet, Dr Mathieu
• Authors: Wu, J., Ghosh, S., Chollet, M., Ly, S., Mozgai, S., and Scherer, S.
• College/School: College of Science and Engineering > School of Computing Science
• ISSN: 1548-8403
• ISBN: 9781510868083