We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Disentangled Generative Models for Robust Prediction of System Dynamics

Abstract: Deep neural networks have become increasingly of interest in dynamical system prediction, but out-of-distribution generalization and long-term stability still remains challenging. In this work, we treat the domain parameters of dynamical systems as factors of variation of the data generating process. By leveraging ideas from supervised disentanglement and causal factorization, we aim to separate the domain parameters from the dynamics in the latent space of generative models. In our experiments we model dynamics both in phase space and in video sequences and conduct rigorous OOD evaluations. Results indicate that disentangled VAEs adapt better to domain parameters spaces that were not present in the training data. At the same time, disentanglement can improve the long-term and out-of-distribution predictions of state-of-the-art models in video sequences.
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Numerical Analysis (math.NA)
Cite as: arXiv:2108.11684 [cs.LG]
  (or arXiv:2108.11684v3 [cs.LG] for this version)

Submission history

From: Stathi Fotiadis [view email]
[v1] Thu, 26 Aug 2021 09:58:06 GMT (1273kb,D)
[v2] Thu, 28 Oct 2021 17:58:08 GMT (3350kb,D)
[v3] Thu, 1 Jun 2023 10:32:38 GMT (9181kb,D)

Link back to: arXiv, form interface, contact.