Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: Towards An End-to-End Framework for Flow-Guided Video Inpainting
(Submitted on 6 Apr 2022 (v1), last revised 7 Apr 2022 (this version, v2))
Abstract: Optical flow, which captures motion information across frames, is exploited in recent video inpainting methods through propagating pixels along its trajectories. However, the hand-crafted flow-based processes in these methods are applied separately to form the whole inpainting pipeline. Thus, these methods are less efficient and rely heavily on the intermediate results from earlier stages. In this paper, we propose an End-to-End framework for Flow-Guided Video Inpainting (E$^2$FGVI) through elaborately designed three trainable modules, namely, flow completion, feature propagation, and content hallucination modules. The three modules correspond with the three stages of previous flow-based methods but can be jointly optimized, leading to a more efficient and effective inpainting process. Experimental results demonstrate that the proposed method outperforms state-of-the-art methods both qualitatively and quantitatively and shows promising efficiency. The code is available at this https URL
Submission history
From: Zhen Li [view email][v1] Wed, 6 Apr 2022 08:24:47 GMT (8269kb,D)
[v2] Thu, 7 Apr 2022 13:35:40 GMT (8269kb,D)
Link back to: arXiv, form interface, contact.