Emotion transfer for 3D hand and full body motion using StarGAN

Chan, J. C. P. and Ho, E. S. L. (2021) Emotion transfer for 3D hand and full body motion using StarGAN. Computers, 10(3), 38. (doi: 10.3390/computers10030038)

Abstract

In this paper, we propose a new data-driven framework for 3D hand and full-body motion emotion transfer. Specifically, we formulate the motion synthesis task as an image-to-image translation problem. By presenting a motion sequence as an image representation, the emotion can be transferred by our framework using StarGAN. To evaluate our proposed method’s effectiveness, we first conducted a user study to validate the perceived emotion from the captured and synthesized hand motions. We further evaluate the synthesized hand and full body motions qualitatively and quantitatively. Experimental results show that our synthesized motions are comparable to the captured motions and those created by an existing method in terms of naturalness and visual quality.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Ho, Dr Edmond S. L

Creator Roles

Ho, E. S.L.: Conceptualization, Methodology, Formal analysis, Investigation, Resources, Data curation, Writing – original draft, Writing – review and editing, Visualization, Supervision, Project administration

• Authors: Chan, J. C. P., and Ho, E. S. L.
• College/School: College of Science and Engineering > School of Computing Science
• Journal Name: Computers
• Publisher: MDPI
• ISSN: 2073-431X
• ISSN (Online): 2073-431X
• Published Online: 22 March 2021
• Copyright Holders: Copyright © 2021 The Authors
• First Published: First published in Computers 10(3): 38
• Publisher Policy: Reproduced under a Creative Commons License