Machine learning for social multiparty human-robot interaction

Keizer, S., Foster, M. E. , Wang, Z. and Lemon, O. (2014) Machine learning for social multiparty human-robot interaction. ACM Transactions on Intelligent Interactive Systems, 4(3), 14. (doi: 10.1145/2600021)

135666.pdf - Accepted Version



We describe a variety of machine-learning techniques that are being applied to social multiuser human--robot interaction using a robot bartender in our scenario. We first present a data-driven approach to social state recognition based on supervised learning. We then describe an approach to social skills execution—that is, action selection for generating socially appropriate robot behavior—which is based on reinforcement learning, using a data-driven simulation of multiple users to train execution policies for social skills. Next, we describe how these components for social state recognition and skills execution have been integrated into an end-to-end robot bartender system, and we discuss the results of a user evaluation. Finally, we present an alternative unsupervised learning framework that combines social state recognition and social skills execution based on hierarchical Dirichlet processes and an infinite POMDP interaction manager. The models make use of data from both human--human interactions collected in a number of German bars and human--robot interactions recorded in the evaluation of an initial version of the system.

Item Type:Articles
Additional Information:The research leading to these results has been funded by the European Commission’s 7th Framework Programme (FP7) under grant agreement no. 270435 (the JAMES project).
Glasgow Author(s) Enlighten ID:Foster, Dr Mary Ellen
Authors: Keizer, S., Foster, M. E., Wang, Z., and Lemon, O.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:ACM Transactions on Intelligent Interactive Systems
ISSN (Online):2160-6463
Copyright Holders:Copyright © 2014 ACM
First Published:First published in ACM Transactions on Intelligent Interactive Systems 4(3): 14
Publisher Policy:Reproduced in accordance with the publisher copyright policy

University Staff: Request a correction | Enlighten Editors: Update this record