References & Citations
Computer Science > Information Theory
Title: Ensemble estimation of multivariate f-divergence
(Submitted on 24 Apr 2014 (v1), last revised 9 Jun 2014 (this version, v2))
Abstract: f-divergence estimation is an important problem in the fields of information theory, machine learning, and statistics. While several divergence estimators exist, relatively few of their convergence rates are known. We derive the MSE convergence rate for a density plug-in estimator of f-divergence. Then by applying the theory of optimally weighted ensemble estimation, we derive a divergence estimator with a convergence rate of O(1/T) that is simple to implement and performs well in high dimensions. We validate our theoretical results with experiments.
Submission history
From: Kevin Moon [view email][v1] Thu, 24 Apr 2014 19:15:27 GMT (54kb,D)
[v2] Mon, 9 Jun 2014 18:49:42 GMT (54kb,D)
Link back to: arXiv, form interface, contact.