We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.SY

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Memory-Efficient Learning of Stable Linear Dynamical Systems for Prediction and Control

Abstract: Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a recent characterization of stable matrices, we present an optimization method that ensures stability at every step and iteratively improves the reconstruction error using gradient directions derived in this paper. When applied to LDSs with inputs, our approach---in contrast to current methods for learning stable LDSs---updates both the state and control matrices, expanding the solution space and allowing for models with lower reconstruction error. We apply our algorithm in simulations and experiments to a variety of problems, including learning dynamic textures from image sequences and controlling a robotic manipulator. Compared to existing approaches, our proposed method achieves an orders-of-magnitude improvement in reconstruction error and superior results in terms of control performance. In addition, it is provably more memory-efficient, with an O(n^2) space complexity compared to O(n^4) of competing alternatives, thus scaling to higher-dimensional systems when the other methods fail.
Comments: Neural Information Processing Systems (NeurIPS) 2020
Subjects: Machine Learning (cs.LG); Robotics (cs.RO); Systems and Control (eess.SY); Optimization and Control (math.OC); Machine Learning (stat.ML)
Cite as: arXiv:2006.03937 [cs.LG]
  (or arXiv:2006.03937v3 [cs.LG] for this version)

Submission history

From: Orest Xherija [view email]
[v1] Sat, 6 Jun 2020 18:44:08 GMT (4256kb,D)
[v2] Sun, 4 Oct 2020 02:25:59 GMT (4258kb,D)
[v3] Thu, 22 Oct 2020 19:38:12 GMT (4263kb,D)

Link back to: arXiv, form interface, contact.