We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Cauchy noise loss for stochastic optimization of random matrix models via free deterministic equivalents

Abstract: For random matrix models, the parameter estimation based on the traditional likelihood functions is not straightforward in particular when we have only one sample matrix. We introduce a new parameter optimization method for random matrix models which works even in such a case. The method is based on the spectral distribution instead of the traditional likelihood. In the method, the Cauchy noise has an essential role because the free deterministic equivalent, which is a tool in free probability theory, allows us to approximate the spectral distribution perturbed by Cauchy noises by a smooth and accessible density function.
Moreover, we study an asymptotic property of determination gap, which has a similar role as generalization gap. Besides, we propose a new dimensionality recovery method for the signal-plus-noise model, and experimentally demonstrate that it recovers the rank of the signal part even if the true rank is not small. It is a simultaneous rank selection and parameter estimation procedure.
Comments: 29 pages, 13 figures, v3: minor correction. Submitted. Our simulation code is available at this https URL Submitted to a journal
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Operator Algebras (math.OA); Probability (math.PR)
Journal reference: Journal of Mathematical Analysis and Applications Volume 483, Issue 2, 15 March 2020, 123597
Cite as: arXiv:1804.03154 [stat.ML]
  (or arXiv:1804.03154v4 [stat.ML] for this version)

Submission history

From: Tomohiro Hayase [view email]
[v1] Mon, 9 Apr 2018 18:00:08 GMT (1173kb,D)
[v2] Wed, 27 Jun 2018 11:21:26 GMT (2206kb,D)
[v3] Sun, 5 Aug 2018 10:05:13 GMT (2207kb,D)
[v4] Tue, 3 Sep 2019 15:12:37 GMT (2207kb,D)

Link back to: arXiv, form interface, contact.