A framework for automatic and perceptually valid facial expression generation

Yu, H., Garrod, O., Jack, R. and Schyns, P. (2015) A framework for automatic and perceptually valid facial expression generation. Multimedia Tools and Applications, 74(21), pp. 9427-9447. (doi: 10.1007/s11042-014-2125-9)

Full text not currently available from Enlighten.


Facial expressions are facial movements reflecting the internal emotional states of a character or in response to social communications. Realistic facial animation should consider at least two factors: believable visual effect and valid facial movements. However, most research tends to separate these two issues. In this paper, we present a framework for generating 3D facial expressions considering both the visual the dynamics effect. A facial expression mapping approach based on local geometry encoding is proposed, which encodes deformation in the 1-ring vector. This method is capable of mapping subtle facial movements without considering those shape and topological constraints. Facial expression mapping is achieved through three steps: correspondence establishment, deviation transfer and movement mapping. Deviation is transferred to the conformal face space through minimizing the error function. This function is formed by the source neutral and the deformed face model related by those transformation matrices in 1-ring neighborhood. The transformation matrix in 1-ring neighborhood is independent of the face shape and the mesh topology. After the facial expression mapping, dynamic parameters are then integrated with facial expressions for generating valid facial expressions. The dynamic parameters were generated based on psychophysical methods. The efficiency and effectiveness of the proposed methods have been tested using various face models with different shapes and topological representations.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Garrod, Dr Oliver and Yu, Mr Hui and Jack, Professor Rachael and Schyns, Professor Philippe
Authors: Yu, H., Garrod, O., Jack, R., and Schyns, P.
College/School:College of Medical Veterinary and Life Sciences > School of Psychology & Neuroscience
College of Science and Engineering > School of Psychology
Journal Name:Multimedia Tools and Applications
Publisher:Springer US
ISSN (Online):1573-7721

University Staff: Request a correction | Enlighten Editors: Update this record