References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Task Agnostic Restoration of Natural Video Dynamics
(Submitted on 8 Jun 2022 (v1), last revised 19 Aug 2023 (this version, v2))
Abstract: In many video restoration/translation tasks, image processing operations are na\"ively extended to the video domain by processing each frame independently, disregarding the temporal connection of the video frames. This disregard for the temporal connection often leads to severe temporal inconsistencies. State-Of-The-Art (SOTA) techniques that address these inconsistencies rely on the availability of unprocessed videos to implicitly siphon and utilize consistent video dynamics to restore the temporal consistency of frame-wise processed videos which often jeopardizes the translation effect. We propose a general framework for this task that learns to infer and utilize consistent motion dynamics from inconsistent videos to mitigate the temporal flicker while preserving the perceptual quality for both the temporally neighboring and relatively distant frames without requiring the raw videos at test time. The proposed framework produces SOTA results on two benchmark datasets, DAVIS and videvo.net, processed by numerous image processing applications. The code and the trained models are available at \url{this https URL}.
Submission history
From: Muhammad Kashif Ali Mr. [view email][v1] Wed, 8 Jun 2022 09:00:31 GMT (43669kb,D)
[v2] Sat, 19 Aug 2023 04:51:11 GMT (29712kb,D)
Link back to: arXiv, form interface, contact.