References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Hybrid Local-Global Transformer for Image Dehazing
(Submitted on 15 Sep 2021 (this version), latest version 5 Jan 2022 (v3))
Abstract: Recently, the Vision Transformer (ViT) has shown impressive performance on high-level and low-level vision tasks. In this paper, we propose a new ViT architecture, named Hybrid Local-Global Vision Transformer (HyLoG-ViT), for single image dehazing. The HyLoG-ViT block consists of two paths, the local ViT path and the global ViT path, which are used to capture local and global dependencies. The hybrid features are fused via convolution layers. As a result, the HyLoG-ViT reduces the computational complexity and introduces locality in the networks. Then, the HyLoG-ViT blocks are incorporated within our dehazing networks, which jointly learn the intrinsic image decomposition and image dehazing. Specifically, the network consists of one shared encoder and three decoders for reflectance prediction, shading prediction, and haze-free image generation. The tasks of reflectance and shading prediction can produce meaningful intermediate features that can serve as complementary features for haze-free image generation. To effectively aggregate the complementary features, we propose a complementary features selection module (CFSM) to select the useful ones for image dehazing. Extensive experiments on homogeneous, non-homogeneous, and nighttime dehazing tasks reveal that our proposed Transformer-based dehazing network can achieve comparable or even better performance than CNNs-based dehazing models.
Submission history
From: Dong Zhao [view email][v1] Wed, 15 Sep 2021 06:13:22 GMT (14987kb,D)
[v2] Sat, 18 Sep 2021 04:37:52 GMT (14988kb,D)
[v3] Wed, 5 Jan 2022 03:05:45 GMT (7481kb,D)
Link back to: arXiv, form interface, contact.