It’s not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training

Biancardi, B., Duan, Y., Chollet, M. and Clavel, C. (2023) It’s not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training. In: 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - HUCAPP, Lisbon, Portugal, 19-21 Feb 2023, pp. 193-200. ISBN 9789897586347 (doi: 10.5220/0011680400003417)

Abstract

Most of the emerging public speaking training systems, while very promising, leverage temporal-aggregate features, which do not take into account the structure of the speech. In this paper, we take a different perspective, testing whether some well-known socio-cognitive theories, like first impressions or primacy and recency effect, apply in the distinct context of public speaking perception. We investigated the impact of the temporal location of speech slices (i.e., at the beginning, middle or end) on the perception of confidence and persuasiveness of speakers giving online movie reviews (the Persuasive Opinion Multimedia dataset). Results show that, when considering multi-modality, usually the middle part of speech is the most informative. Additional findings also suggest the interest to leverage local interpretability (by computing SHAP values) to provide feedback directly, both at a specific time (what speech part?) and for a specific behaviour modality or feature (what behaviour ?). This is a first step towards the design of more explainable and pedagogical interactive training systems. Such systems could be more efficient by focusing on improving the speaker’s most important behaviour during the most important moments of their performance, and by situating feedback at specific places within the total speech.

• Item Type: Conference Proceedings
• Additional Information: This work was partially funded by the Carnot institutes TSN and M.I.N.E.S. under the InterCarnot contract 200000830 AI4SoftSkills and the ANR-21-CE33-0016-02 REVITALISE project.
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Chollet, Dr Mathieu
• Authors: Biancardi, B., Duan, Y., Chollet, M., and Clavel, C.
• College/School: College of Science and Engineering > School of Computing Science
• Publisher: SciTePress
• ISSN: 2184-4321
• ISBN: 9789897586347
• Copyright Holders: Copyright © 2023 SCITEPRESS – Science and Technology Publications, Lda.
• First Published: First published in Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP, pp 193-200
• Publisher Policy: Reproduced under a Creative Commons License

Related URLs

• Organisation