Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Hierarchical Temporal Representation in Linear Reservoir Computing
(Submitted on 16 May 2017 (v1), last revised 10 Jul 2017 (this version, v5))
Abstract: Recently, studies on deep Reservoir Computing (RC) highlighted the role of layering in deep recurrent neural networks (RNNs). In this paper, the use of linear recurrent units allows us to bring more evidence on the intrinsic hierarchical temporal representation in deep RNNs through frequency analysis applied to the state signals. The potentiality of our approach is assessed on the class of Multiple Superimposed Oscillator tasks. Furthermore, our investigation provides useful insights to open a discussion on the main aspects that characterize the deep learning framework in the temporal domain.
Submission history
From: Claudio Gallicchio [view email][v1] Tue, 16 May 2017 16:03:00 GMT (495kb,D)
[v2] Wed, 17 May 2017 10:30:52 GMT (460kb,D)
[v3] Mon, 5 Jun 2017 12:03:06 GMT (460kb,D)
[v4] Thu, 8 Jun 2017 16:00:15 GMT (460kb,D)
[v5] Mon, 10 Jul 2017 10:51:24 GMT (460kb,D)
Link back to: arXiv, form interface, contact.