We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: A Joint Convolution Auto-encoder Network for Infrared and Visible Image Fusion

Abstract: Background: Leaning redundant and complementary relationships is a critical step in the human visual system. Inspired by the infrared cognition ability of crotalinae animals, we design a joint convolution auto-encoder (JCAE) network for infrared and visible image fusion. Methods: Our key insight is to feed infrared and visible pair images into the network simultaneously and separate an encoder stream into two private branches and one common branch, the private branch works for complementary features learning and the common branch does for redundant features learning. We also build two fusion rules to integrate redundant and complementary features into their fused feature which are then fed into the decoder layer to produce the final fused image. We detail the structure, fusion rule and explain its multi-task loss function. Results: Our JCAE network achieves good results in terms of both subjective effect and objective evaluation metrics.
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2201.10736 [cs.CV]
  (or arXiv:2201.10736v1 [cs.CV] for this version)

Submission history

From: Xiaoqing Luo [view email]
[v1] Wed, 26 Jan 2022 03:49:27 GMT (28950kb,D)

Link back to: arXiv, form interface, contact.