We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Unsupervised Image Fusion Using Deep Image Priors

Abstract: A significant number of researchers have applied deep learning methods to image fusion. However, most works require a large amount of training data or depend on pre-trained models or frameworks to capture features from source images. This is inevitably hampered by a shortage of training data or a mismatch between the framework and the actual problem. Deep Image Prior (DIP) has been introduced to exploit convolutional neural networks' ability to synthesize the 'prior' in the input image. However, the original design of DIP is hard to be generalized to multi-image processing problems, particularly for image fusion. Therefore, we propose a new image fusion technique that extends DIP to fusion tasks formulated as inverse problems. Additionally, we apply a multi-channel approach to enhance DIP's effect further. The evaluation is conducted with several commonly used image fusion assessment metrics. The results are compared with state-of-the-art image fusion methods. Our method outperforms these techniques for a range of metrics. In particular, it is shown to provide the best objective results for most metrics when applied to medical images.
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2110.09490 [cs.CV]
  (or arXiv:2110.09490v3 [cs.CV] for this version)

Submission history

From: Xudong Ma [view email]
[v1] Mon, 18 Oct 2021 17:38:35 GMT (1809kb,D)
[v2] Sun, 24 Oct 2021 14:08:14 GMT (1809kb,D)
[v3] Tue, 22 Feb 2022 16:52:27 GMT (1810kb,D)

Link back to: arXiv, form interface, contact.