We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: EFENet: Reference-based Video Super-Resolution with Enhanced Flow Estimation

Abstract: In this paper, we consider the problem of reference-based video super-resolution(RefVSR), i.e., how to utilize a high-resolution (HR) reference frame to super-resolve a low-resolution (LR) video sequence. The existing approaches to RefVSR essentially attempt to align the reference and the input sequence, in the presence of resolution gap and long temporal range. However, they either ignore temporal structure within the input sequence, or suffer accumulative alignment errors. To address these issues, we propose EFENet to exploit simultaneously the visual cues contained in the HR reference and the temporal information contained in the LR sequence. EFENet first globally estimates cross-scale flow between the reference and each LR frame. Then our novel flow refinement module of EFENet refines the flow regarding the furthest frame using all the estimated flows, which leverages the global temporal information within the sequence and therefore effectively reduces the alignment errors. We provide comprehensive evaluations to validate the strengths of our approach, and to demonstrate that the proposed framework outperforms the state-of-the-art methods. Code is available at this https URL
Comments: 12 pages, 6 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2110.07797 [cs.CV]
  (or arXiv:2110.07797v2 [cs.CV] for this version)

Submission history

From: Yaping Zhao [view email]
[v1] Fri, 15 Oct 2021 01:36:30 GMT (16508kb,D)
[v2] Thu, 28 Oct 2021 07:59:52 GMT (16508kb,D)

Link back to: arXiv, form interface, contact.