Self-supervised Frontalization and Rotation GAN with Random Swap for Pose-invariant Face Recognition

Liao, J., Guha, T. and Sanchez, V. (2022) Self-supervised Frontalization and Rotation GAN with Random Swap for Pose-invariant Face Recognition. In: 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France, 16-19 Oct 2022, pp. 911-915. ISBN 9781665496209 (doi: 10.1109/ICIP46576.2022.9897944)

Abstract

The task of pose invariant face recognition (PIFR) has recently seen important improvements by introducing generative adversarial networks (GANs). These GAN-based models synthesize a frontal face image from an image in any pose to boost recognition performance. Most of these methods, however, require the ground-truth frontal face image during optimization as they rely on supervised or semi-supervised learning. In this work, we introduce the self-supervised Frontalization and Rotation GAN (FRGAN), which can synthesize a frontal face image from a non-frontal face image. For self-supervision, the synthesized image is rotated back to the original pose based on reconstruction and adversarial losses. To improve performance, the FRGAN uses the Random Swap, a parameter-free data augmentation strategy that swaps key facial regions between the input image and its reconstructed version to force the generator to synthesize more realistic images. Our qualitative and quantitative experiments on benchmark datasets confirm the strong performance of the FRGAN compared to the state-of-the-art (SOTA).

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Guha, Dr Tanaya
• Authors: Liao, J., Guha, T., and Sanchez, V.
• College/School: College of Science and Engineering > School of Computing Science
• ISSN: 2381-8549
• ISBN: 9781665496209
• Published Online: 18 October 2022
• Copyright Holders: Copyright © 2022 IEEE
• Publisher Policy: Reproduced in accordance with the publisher copyright policy

Related URLs

• Organisation
• Publisher