References & Citations
Statistics > Machine Learning
Title: Algebraic Representation of Probability Distributions
(Submitted on 20 Oct 2011 (v1), revised 14 Nov 2011 (this version, v2), latest version 25 Mar 2013 (v4))
Abstract: We show that the use of techniques from algebra and algebraic geometry can be highly beneficial for tackling machine learning problems, where the set of desired solutions can be described in terms of approximate polynomial equations. Namely, they allow one to directly solve learning problems using algebraic operations thus avoiding iterative optimization which may converge to local minima. In this spirit, we suggest a novel representation for probability distributions in terms of elements in the polynomial ring derived from estimated cumulants. Demonstrating the versatility of our framework, we present an algorithm for finding the linear subspace on which estimated probability distributions are stationary w.r.t. to chosen cumulants of arbitrary degree and for arbitrary numbers of dimensions. Apart from showing interesting theoretical proof techniques, we illustrate that the algebraic approach is significantly more accurate than optimization-based methods in numerical simulations.
Submission history
From: Franz J. Király [view email][v1] Thu, 20 Oct 2011 13:51:16 GMT (469kb,D)
[v2] Mon, 14 Nov 2011 15:12:58 GMT (469kb,D)
[v3] Mon, 20 Feb 2012 10:06:54 GMT (619kb,D)
[v4] Mon, 25 Mar 2013 16:39:38 GMT (641kb,D)
Link back to: arXiv, form interface, contact.