We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Error rate control for classification rules in multiclass mixture models

Authors: Tristan Mary-Huard (GQE-Le Moulon, MIA-Paris), Vittorio Perduca (MAP5 - UMR 8145), Gilles Blanchard (LMO, DATASHAPE), Martin-Magniette Marie-Laure (IPS2 (UMR\_9213 / UMR\_1403), MIA-Paris)
Abstract: In the context of finite mixture models one considers the problem of classifying as many observations as possible in the classes of interest while controlling the classification error rate in these same classes. Similar to what is done in the framework of statistical test theory, different type I and type II-like classification error rates can be defined, along with their associated optimal rules, where optimality is defined as minimizing type II error rate while controlling type I error rate at some nominal level. It is first shown that finding an optimal classification rule boils down to searching an optimal region in the observation space where to apply the classical Maximum A Posteriori (MAP) rule. Depending on the misclassification rate to be controlled, the shape of the optimal region is provided, along with a heuristic to compute the optimal classification rule in practice. In particular, a multiclass FDR-like optimal rule is defined and compared to the thresholded MAP rules that is used in most applications. It is shown on both simulated and real datasets that the FDR-like optimal rule may be significantly less conservative than the thresholded MAP rule.
Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)
Cite as: arXiv:2109.14235 [cs.LG]
  (or arXiv:2109.14235v1 [cs.LG] for this version)

Submission history

From: Gilles Blanchard [view email]
[v1] Wed, 29 Sep 2021 07:18:33 GMT (1225kb,D)

Link back to: arXiv, form interface, contact.