We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: Hybrid Local-Global Transformer for Image Dehazing

Abstract: Recently, the Vision Transformer (ViT) has shown impressive performance on high-level and low-level vision tasks. In this paper, we propose a new ViT architecture, named Hybrid Local-Global Vision Transformer (HyLoG-ViT), for single image dehazing. The HyLoG-ViT block consists of two paths, the local ViT path and the global ViT path, which are used to capture local and global dependencies. The hybrid features are fused via convolution layers. As a result, the HyLoG-ViT reduces the computational complexity and introduces locality in the networks. Then, the HyLoG-ViT blocks are incorporated within our dehazing networks, which jointly learn the intrinsic image decomposition and image dehazing. Specifically, the network consists of one shared encoder and three decoders for reflectance prediction, shading prediction, and haze-free image generation. The tasks of reflectance and shading prediction can produce meaningful intermediate features that can serve as complementary features for haze-free image generation. To effectively aggregate the complementary features, we propose a complementary features selection module (CFSM) to select the useful ones for image dehazing. Extensive experiments on homogeneous, non-homogeneous, and nighttime dehazing tasks reveal that our proposed Transformer-based dehazing network can achieve comparable or even better performance than CNNs-based dehazing models.
Comments: 19 pages,17 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV)
MSC classes: 68U10 (Primary) 94A08, 54H30 (Secondary)
ACM classes: I.4.3; I.4.4
Cite as: arXiv:2109.07100 [cs.CV]
  (or arXiv:2109.07100v1 [cs.CV] for this version)

Submission history

From: Dong Zhao [view email]
[v1] Wed, 15 Sep 2021 06:13:22 GMT (14987kb,D)
[v2] Sat, 18 Sep 2021 04:37:52 GMT (14988kb,D)
[v3] Wed, 5 Jan 2022 03:05:45 GMT (7481kb,D)

Link back to: arXiv, form interface, contact.