Native vs. Non-Native Language Fluency Implications on Multimodal Interaction for Interpersonal Skills Training

Chollet, M. , Prendinger, H. and Scherer, S. (2016) Native vs. Non-Native Language Fluency Implications on Multimodal Interaction for Interpersonal Skills Training. In: 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan, 12-16 Nov 2016, pp. 386-393. ISBN 9781450345569 (doi: 10.1145/2993148.2993196)

Full text not currently available from Enlighten.

Abstract

New technological developments in the field of multimodal interaction show great promise for the improvement and assessment of public speaking skills. However, it is unclear how the experience of non-native speakers interacting with such technologies differs from native speakers. In particular, non-native speakers could benefit less from training with multimodal systems compared to native speakers. Additionally, machine learning models trained for the automatic assessment of public speaking ability on data of native speakers might not be performing well for assessing the performance of non-native speakers. In this paper, we investigate two aspects related to the performance and evaluation of multimodal interaction technologies designed for the improvement and assessment of public speaking between a population of English native speakers and a population of non-native English speakers. Firstly, we compare the experiences and training outcomes of these two populations interacting with a virtual audience system designed for training public speaking ability, collecting a dataset of public speaking presentations in the process. Secondly, using this dataset, we build regression models for predicting public speaking performance on both populations and evaluate these models, both on the population they were trained on and on how they generalize to the second population.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Chollet, Dr Mathieu
Authors: Chollet, M., Prendinger, H., and Scherer, S.
College/School:College of Science and Engineering > School of Computing Science
ISBN:9781450345569

University Staff: Request a correction | Enlighten Editors: Update this record