We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Vision and Pattern Recognition

Title: Closer Look at the Uncertainty Estimation in Semantic Segmentation under Distributional Shift

Abstract: While recent computer vision algorithms achieve impressive performance on many benchmarks, they lack robustness - presented with an image from a different distribution, (e.g. weather or lighting conditions not considered during training), they may produce an erroneous prediction. Therefore, it is desired that such a model will be able to reliably predict its confidence measure. In this work, uncertainty estimation for the task of semantic segmentation is evaluated under a varying level of domain shift: in a cross-dataset setting and when adapting a model trained on data from the simulation. It was shown that simple color transformations already provide a strong baseline, comparable to using more sophisticated style-transfer data augmentation. Further, by constructing an ensemble consisting of models using different backbones and/or augmentation methods, it was possible to improve significantly model performance in terms of overall accuracy and uncertainty estimation under the domain shift setting. The Expected Calibration Error (ECE) on challenging GTA to Cityscapes adaptation was reduced from 4.05 to the competitive value of 1.1. Further, an ensemble of models was utilized in the self-training setting to improve the pseudo-labels generation, which resulted in a significant gain in the final model accuracy, compared to the standard fine-tuning (without ensemble).
Comments: International Joint Conference on Neural Networks 2021, this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV)
DOI: 10.1109/IJCNN52387.2021.9533330
Cite as: arXiv:2106.00076 [cs.CV]
  (or arXiv:2106.00076v2 [cs.CV] for this version)

Submission history

From: Sebastian Cygert [view email]
[v1] Mon, 31 May 2021 19:50:43 GMT (12864kb,D)
[v2] Mon, 27 Sep 2021 10:04:18 GMT (12864kb,D)

Link back to: arXiv, form interface, contact.