We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Multi-Scale Feature Aggregation by Cross-Scale Pixel-to-Region Relation Operation for Semantic Segmentation

Abstract: Exploiting multi-scale features has shown great potential in tackling semantic segmentation problems. The aggregation is commonly done with sum or concatenation (concat) followed by convolutional (conv) layers. However, it fully passes down the high-level context to the following hierarchy without considering their interrelation. In this work, we aim to enable the low-level feature to aggregate the complementary context from adjacent high-level feature maps by a cross-scale pixel-to-region relation operation. We leverage cross-scale context propagation to make the long-range dependency capturable even by the high-resolution low-level features. To this end, we employ an efficient feature pyramid network to obtain multi-scale features. We propose a Relational Semantics Extractor (RSE) and Relational Semantics Propagator (RSP) for context extraction and propagation respectively. Then we stack several RSP into an RSP head to achieve the progressive top-down distribution of the context. Experiment results on two challenging datasets Cityscapes and COCO demonstrate that the RSP head performs competitively on both semantic segmentation and panoptic segmentation with high efficiency. It outperforms DeeplabV3 [1] by 0.7% with 75% fewer FLOPs (multiply-adds) in the semantic segmentation task.
Comments: Accepted to RA-L 2021. in IEEE Robotics and Automation Letters. The contents of this paper were also selected by the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021) Program Committee for presentation at the Conference
Subjects: Computer Vision and Pattern Recognition (cs.CV)
DOI: 10.1109/LRA.2021.3086419
Cite as: arXiv:2106.01744 [cs.CV]
  (or arXiv:2106.01744v2 [cs.CV] for this version)

Submission history

From: Ye Chao Bai [view email]
[v1] Thu, 3 Jun 2021 10:49:48 GMT (7549kb,D)
[v2] Sat, 25 Jun 2022 13:31:07 GMT (7549kb,D)

Link back to: arXiv, form interface, contact.