Wörtwein, T., Morency, L. -P., Chollet, M. , Stiefelhagen, R., Schauerte, B. and Scherer, S. (2015) Multimodal Public Speaking Performance Assessment. In: International Conference on Multimodal Interaction (ICMI '15), Seattle, WA, USA, 09-13 Nov 2015, pp. 43-50. ISBN 9781450339124 (doi: 10.1145/2818346.2820762)
Full text not currently available from Enlighten.
Abstract
The ability to speak proficiently in public is essential for many professions and in everyday life. Public speaking skills are difficult to master and require extensive training. Recent developments in technology enable new approaches for public speaking training that allow users to practice in engaging and interactive environments. Here, we focus on the automatic assessment of nonverbal behavior and multimodal modeling of public speaking behavior. We automatically identify audiovisual nonverbal behaviors that are correlated to expert judges' opinions of key performance aspects. These automatic assessments enable a virtual audience to provide feedback that is essential for training during a public speaking performance. We utilize multimodal ensemble tree learners to automatically approximate expert judges' evaluations to provide post-hoc performance assessments to the speakers. Our automatic performance evaluation is highly correlated with the experts' opinions with r = 0.745 for the overall performance assessments. We compare multimodal approaches with single modalities and find that the multimodal ensembles consistently outperform single modalities.
| Item Type: | Conference Proceedings |
|---|---|
| Additional Information: | This material is based upon work supported by the National Science Foundation under Grants No. IIS-1421330 and U.S. Army Research Laboratory under contract number W911NF-14-D-0005. |
| Status: | Published |
| Refereed: | Yes |
| Glasgow Author(s) Enlighten ID: | Chollet, Dr Mathieu |
| Authors: | Wörtwein, T., Morency, L. -P., Chollet, M., Stiefelhagen, R., Schauerte, B., and Scherer, S. |
| College/School: | College of Science and Engineering > School of Computing Science |
| Journal Name: | ICMI 2015 - Proceedings of the 2015 ACM International Conference on Multimodal Interaction |
| ISBN: | 9781450339124 |
| Related URLs: |
University Staff: Request a correction | Enlighten Editors: Update this record
Deposit and Record Details
Deposit and Record Details