Learning Generative Models of Social Interactions with Humans-in-the-Loop

Feng, D., Sequeira, P., Carstensdottir, E., Seif El-Nasr, M. and Marsella, S. (2019) Learning Generative Models of Social Interactions with Humans-in-the-Loop. In: 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, Florida, USA, 17-20 Dec 2018, pp. 509-516. ISBN 9781538668061 (doi: 10.1109/ICMLA.2018.00082)

Full text not currently available from Enlighten.


The development of agents that can engage in human social interaction has become critical in an increasingly wide range of applications. The focus of this work is modeling agents for social skills training where learners can interact with the autonomous characters in social scenarios and thereby acquire skills that can be applied in the real world. A key goal in the design of these systems is to allow users to explore various actions and tactics while still having the agents generate consistent and diverse responses. Providing the ability to explore different tactics raises a significant content challenge for the design of agents. To tackle the creative content creation problem, this paper introduces a humans-in-the-loop iterative process to automatically generate rich, varied content from a small amount of vignettes provided by online crowd workers. Specifically, this process uses the crowd to iteratively refine and improve an ensemble of generative models. The results show that the iterative, ensemble based approach generates more coherent and novel interactions than alternative non-ensemble, non-iterative approaches. The results presented in this paper can potentially provide the basis for flexible agent-based training systems.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Marsella, Professor Stacy
Authors: Feng, D., Sequeira, P., Carstensdottir, E., Seif El-Nasr, M., and Marsella, S.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience

University Staff: Request a correction | Enlighten Editors: Update this record