Short-long-term propagation-based video inpainting

Li, S., Zhu, S., Huang, Y., Liu, S., Zeng, B., Imran, M. A. , Abbasi, Q. H. and Cooper, J. (2023) Short-long-term propagation-based video inpainting. IEEE MultiMedia, 30(4), pp. 91-104. (doi: 10.1109/MMUL.2023.3309476)

Abstract

In this paper, we propose a new method to inpaint videos with removed regions. Our method was developed based upon combining both short-term propagation-based inpainting (STPI) and long-term propagation-based inpainting (LTPI) modules. The STPI module is designed to in-fill an image from a single frame with local reference information, whilst the LTPI module uses multiple STPI modules to inpaint the whole video, giving a high temporal consistency and a low complexity. With both of the proposed modules, the correlated spatio-temporal information of frames can be propagated throughout the video, offering reliable short-long-term source information for inpainting. The experimental results demonstrate that our proposed method provides better results when compared with the state-of-the-art.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Cooper, Professor Jonathan and Imran, Professor Muhammad and Li, Shibo and Abbasi, Professor Qammer
• Authors: Li, S., Zhu, S., Huang, Y., Liu, S., Zeng, B., Imran, M. A., Abbasi, Q. H., and Cooper, J.
• College/School: College of Science and Engineering > School of Engineering > Autonomous Systems and Connectivity; College of Science and Engineering > School of Engineering > Biomedical Engineering; College of Science and Engineering > School of Engineering > Electronics and Nanoscale Engineering
• Journal Name: IEEE MultiMedia
• Publisher: IEEE
• ISSN: 1070-986X
• ISSN (Online): 1941-0166
• Published Online: 28 August 2023
• Copyright Holders: Copyright © 2023 IEEE
• First Published: First published in IEEE MultiMedia 30(4):91-104
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher