Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Pulling back information geometry
(Submitted on 9 Jun 2021 (v1), last revised 23 Apr 2022 (this version, v2))
Abstract: Latent space geometry has shown itself to provide a rich and rigorous framework for interacting with the latent variables of deep generative models. The existing theory, however, relies on the decoder being a Gaussian distribution as its simple reparametrization allows us to interpret the generating process as a random projection of a deterministic manifold. Consequently, this approach breaks down when applied to decoders that are not as easily reparametrized. We here propose to use the Fisher-Rao metric associated with the space of decoder distributions as a reference metric, which we pull back to the latent space. We show that we can achieve meaningful latent geometries for a wide range of decoder distributions for which the previous theory was not applicable, opening the door to `black box' latent geometries.
Submission history
From: Miguel González-Duque [view email][v1] Wed, 9 Jun 2021 20:16:28 GMT (15371kb,D)
[v2] Sat, 23 Apr 2022 07:54:23 GMT (22991kb,D)
Link back to: arXiv, form interface, contact.