We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Learning from Noisy Labels with Deep Neural Networks: A Survey

Abstract: Deep learning has achieved remarkable success in numerous domains with help from large amounts of big data. However, the quality of data labels is a concern because of the lack of high-quality labels in many real-world scenarios. As noisy labels severely degrade the generalization performance of deep neural networks, learning from noisy labels (robust training) is becoming an important task in modern deep learning applications. In this survey, we first describe the problem of learning with label noise from a supervised learning perspective. Next, we provide a comprehensive review of 62 state-of-the-art robust training methods, all of which are categorized into five groups according to their methodological difference, followed by a systematic comparison of six properties used to evaluate their superiority. Subsequently, we perform an in-depth analysis of noise rate estimation and summarize the typically used evaluation methodology, including public noisy datasets and evaluation metrics. Finally, we present several promising research directions that can serve as a guideline for future studies. All the contents will be available at this https URL
Comments: Final version published in TNNLS Journal (2022 March)
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
Cite as: arXiv:2007.08199 [cs.LG]
  (or arXiv:2007.08199v7 [cs.LG] for this version)

Submission history

From: Hwanjun Song [view email]
[v1] Thu, 16 Jul 2020 09:23:13 GMT (1606kb,D)
[v2] Tue, 21 Jul 2020 14:09:46 GMT (1606kb,D)
[v3] Wed, 28 Oct 2020 03:38:50 GMT (1606kb,D)
[v4] Mon, 5 Apr 2021 04:43:20 GMT (2303kb,D)
[v5] Tue, 8 Jun 2021 11:32:13 GMT (2303kb,D)
[v6] Wed, 10 Nov 2021 15:42:28 GMT (2307kb,D)
[v7] Thu, 10 Mar 2022 01:51:43 GMT (2306kb,D)

Link back to: arXiv, form interface, contact.