Emotion transfer for 3D hand and full body motion using StarGAN

Chan, J. C. P. and Ho, E. S. L. (2021) Emotion transfer for 3D hand and full body motion using StarGAN. Computers, 10(3), 38. (doi: 10.3390/computers10030038)

[img] Text
276357.pdf - Published Version
Available under License Creative Commons Attribution.



In this paper, we propose a new data-driven framework for 3D hand and full-body motion emotion transfer. Specifically, we formulate the motion synthesis task as an image-to-image translation problem. By presenting a motion sequence as an image representation, the emotion can be transferred by our framework using StarGAN. To evaluate our proposed method’s effectiveness, we first conducted a user study to validate the perceived emotion from the captured and synthesized hand motions. We further evaluate the synthesized hand and full body motions qualitatively and quantitatively. Experimental results show that our synthesized motions are comparable to the captured motions and those created by an existing method in terms of naturalness and visual quality.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Ho, Dr Edmond S. L
Creator Roles:
Ho, E. S.L.Conceptualization, Methodology, Formal analysis, Investigation, Resources, Data curation, Writing – original draft, Writing – review and editing, Visualization, Supervision, Project administration
Authors: Chan, J. C. P., and Ho, E. S. L.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Computers
ISSN (Online):2073-431X
Published Online:22 March 2021
Copyright Holders:Copyright © 2021 The Authors
First Published:First published in Computers 10(3): 38
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record