Current browse context:
math.ST
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Information Measures, Experiments, Multi-category Hypothesis Tests, and Surrogate Losses
(Submitted on 1 Mar 2016 (this version), latest version 10 Sep 2017 (v2))
Abstract: We provide a unifying view of statistical information measures, multi-class classification problems, multi-way Bayesian hypothesis testing, and loss functions, elaborating equivalence results between all of these objects. In particular, we consider a particular generalization of $f$-divergences to multiple distributions, and we show that there is a constructive equivalence between $f$-divergences, statistical information (in the sense of uncertainty as elaborated by DeGroot), and loss functions for multi-category classification. We also study an extension of our results to multi-class classification problems in which we must both infer a discriminant function $\gamma$ and a data representation (or, in the setting of a hypothesis testing problem, an experimental design), represented by a quantizer $\mathsf{q}$ from a family of possible quantizers $\mathsf{Q}$. There, we give a complete characterization of the equivalence between loss functions, meaning that optimizing either of two losses yields the same optimal discriminant and quantizer $\mathsf{q}$. A main consequence of our results is to describe those convex loss functions that are Fisher consistent for jointly choosing a data representation and minimizing the (weighted) probability of error in multi-category classification and hypothesis testing problems.
Submission history
From: Khashayar Khosravi [view email][v1] Tue, 1 Mar 2016 03:28:27 GMT (74kb)
[v2] Sun, 10 Sep 2017 20:27:00 GMT (114kb)
Link back to: arXiv, form interface, contact.