We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Full Kullback-Leibler-Divergence Loss for Hyperparameter-free Label Distribution Learning

Abstract: The concept of Label Distribution Learning (LDL) is a technique to stabilize classification and regression problems with ambiguous and/or imbalanced labels. A prototypical use-case of LDL is human age estimation based on profile images. Regarding this regression problem, a so called Deep Label Distribution Learning (DLDL) method has been developed. The main idea is the joint regression of the label distribution and its expectation value. However, the original DLDL method uses loss components with different mathematical motivation and, thus, different scales, which is why the use of a hyperparameter becomes necessary. In this work, we introduce a loss function for DLDL whose components are completely defined by Kullback-Leibler (KL) divergences and, thus, are directly comparable to each other without the need of additional hyperparameters. It generalizes the concept of DLDL with regard to further use-cases, in particular for multi-dimensional or multi-scale distribution learning tasks.
Comments: 8 pages, 4 figures
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2209.02055 [cs.LG]
  (or arXiv:2209.02055v1 [cs.LG] for this version)

Submission history

From: Maurice Günder M.Sc. [view email]
[v1] Mon, 5 Sep 2022 17:01:46 GMT (8314kb,D)

Link back to: arXiv, form interface, contact.