Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: On Contrastive Representations of Stochastic Processes
(Submitted on 18 Jun 2021 (v1), last revised 29 Oct 2021 (this version, v2))
Abstract: Learning representations of stochastic processes is an emerging problem in machine learning with applications from meta-learning to physical object models to time series. Typical methods rely on exact reconstruction of observations, but this approach breaks down as observations become high-dimensional or noise distributions become complex. To address this, we propose a unifying framework for learning contrastive representations of stochastic processes (CReSP) that does away with exact reconstruction. We dissect potential use cases for stochastic process representations, and propose methods that accommodate each. Empirically, we show that our methods are effective for learning representations of periodic functions, 3D objects and dynamical processes. Our methods tolerate noisy high-dimensional observations better than traditional approaches, and the learned representations transfer to a range of downstream tasks.
Submission history
From: Emile Mathieu [view email][v1] Fri, 18 Jun 2021 11:00:24 GMT (2017kb,D)
[v2] Fri, 29 Oct 2021 14:23:46 GMT (1487kb,D)
Link back to: arXiv, form interface, contact.