We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: A Locally Adaptive Normal Distribution

Abstract: The multivariate normal density is a monotonic function of the distance to the mean, and its ellipsoidal shape is due to the underlying Euclidean metric. We suggest to replace this metric with a locally adaptive, smoothly changing (Riemannian) metric that favors regions of high local density. The resulting locally adaptive normal distribution (LAND) is a generalization of the normal distribution to the "manifold" setting, where data is assumed to lie near a potentially low-dimensional manifold embedded in $\mathbb{R}^D$. The LAND is parametric, depending only on a mean and a covariance, and is the maximum entropy distribution under the given metric. The underlying metric is, however, non-parametric. We develop a maximum likelihood algorithm to infer the distribution parameters that relies on a combination of gradient descent and Monte Carlo integration. We further extend the LAND to mixture models, and provide the corresponding EM algorithm. We demonstrate the efficiency of the LAND to fit non-trivial probability distributions over both synthetic data, and EEG measurements of human sleep.
Subjects: Machine Learning (stat.ML)
Cite as: arXiv:1606.02518 [stat.ML]
  (or arXiv:1606.02518v3 [stat.ML] for this version)

Submission history

From: Georgios Arvanitidis [view email]
[v1] Wed, 8 Jun 2016 11:49:08 GMT (4909kb,D)
[v2] Mon, 19 Sep 2016 11:45:33 GMT (4820kb,D)
[v3] Fri, 23 Sep 2016 12:40:51 GMT (4823kb,D)

Link back to: arXiv, form interface, contact.