We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Continuous normalizing flows on manifolds

Authors: Luca Falorsi
Abstract: Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately, current approaches are only available for the most basic geometries and fall short when the underlying space has a nontrivial topology, limiting their applicability for most real-world data. Using fundamental ideas from differential geometry and geometric control theory, we describe how the recently introduced Neural ODEs and continuous normalizing flows can be extended to arbitrary smooth manifolds. We propose a general methodology for parameterizing vector fields on these spaces and demonstrate how gradient-based learning can be performed. Additionally, we provide a scalable unbiased estimator for the divergence in this generalized setting. Experiments on a diverse selection of spaces empirically showcase the defined framework's ability to obtain reparameterizable samples from complex distributions.
Comments: Master Thesis
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:2104.14959 [stat.ML]
  (or arXiv:2104.14959v1 [stat.ML] for this version)

Submission history

From: Luca Falorsi [view email]
[v1] Sun, 14 Mar 2021 15:35:19 GMT (295kb,D)

Link back to: arXiv, form interface, contact.