We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Framing RNN as a kernel method: A neural ODE approach

Abstract: Building on the interpretation of a recurrent neural network (RNN) as a continuous-time neural differential equation, we show, under appropriate conditions, that the solution of a RNN can be viewed as a linear function of a specific feature set of the input sequence, known as the signature. This connection allows us to frame a RNN as a kernel method in a suitable reproducing kernel Hilbert space. As a consequence, we obtain theoretical guarantees on generalization and stability for a large class of recurrent networks. Our results are illustrated on simulated datasets.
Comments: 33 pages, 7 figures, accepted for an oral presentation at NeurIPS 2021
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:2106.01202 [stat.ML]
  (or arXiv:2106.01202v2 [stat.ML] for this version)

Submission history

From: Adeline Fermanian [view email]
[v1] Wed, 2 Jun 2021 14:46:40 GMT (1100kb,D)
[v2] Fri, 29 Oct 2021 14:56:45 GMT (1410kb,D)

Link back to: arXiv, form interface, contact.