Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Time-shift selection for reservoir computing using a rank-revealing QR algorithm
(Submitted on 29 Nov 2022 (v1), last revised 25 Apr 2023 (this version, v3))
Abstract: Reservoir computing, a recurrent neural network paradigm in which only the output layer is trained, has demonstrated remarkable performance on tasks such as prediction and control of nonlinear systems. Recently, it was demonstrated that adding time-shifts to the signals generated by a reservoir can provide large improvements in performance accuracy. In this work, we present a technique to choose the time-shifts by maximizing the rank of the reservoir matrix using a rank-revealing QR algorithm. This technique, which is not task dependent, does not require a model of the system, and therefore is directly applicable to analog hardware reservoir computers. We demonstrate our time-shift selection technique on two types of reservoir computer: one based on an opto-electronic oscillator and the traditional recurrent network with a $tanh$ activation function. We find that our technique provides improved accuracy over random time-shift selection in essentially all cases.
Submission history
From: Joseph Hart [view email][v1] Tue, 29 Nov 2022 14:55:51 GMT (871kb,D)
[v2] Thu, 23 Feb 2023 18:43:30 GMT (911kb,D)
[v3] Tue, 25 Apr 2023 22:24:31 GMT (968kb,D)
Link back to: arXiv, form interface, contact.