We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Deep Fusion Prior for Multi-Focus Image Super Resolution Fusion

Abstract: This paper unifies the multi-focus images fusion (MFIF) and blind super resolution (SR) problems as the multi-focus image super resolution fusion (MFISRF) task, and proposes a novel unified dataset-free unsupervised framework named deep fusion prior (DFP) to address such MFISRF task. DFP consists of SKIPnet network, DoubleReblur focus measurement tactic, decision embedding module and loss functions. In particular, DFP can obtain MFISRF only from two low-resolution inputs without any extent dataset; SKIPnet implementing unsupervised learning via deep image prior is an end-to-end generated network acting as the engine of DFP; DoubleReblur is used to determine the primary decision map without learning but based on estimated PSF and Gaussian kernels convolution; decision embedding module optimizes the decision map via learning; and DFP losses composed of content loss, joint gradient loss and gradient limit loss can obtain high-quality MFISRF results robustly. Experiments have proved that our proposed DFP approaches and even outperforms those state-of-art MFIF and SR method combinations. Additionally, DFP is a general framework, thus its networks and focus measurement tactics can be continuously updated to further improve the MFISRF performance. DFP codes are open source and will be available soon at this http URL
Comments: 21 pages, 9 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
Cite as: arXiv:2110.05706 [cs.CV]
  (or arXiv:2110.05706v3 [cs.CV] for this version)

Submission history

From: Yuanjie Gu [view email]
[v1] Tue, 12 Oct 2021 02:44:07 GMT (2191kb)
[v2] Sun, 8 May 2022 11:13:57 GMT (1782kb)
[v3] Thu, 19 May 2022 13:29:57 GMT (1772kb)
[v4] Thu, 30 Jun 2022 11:49:13 GMT (1525kb)
[v5] Sat, 15 Oct 2022 11:04:18 GMT (9794kb)

Link back to: arXiv, form interface, contact.