We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.NE

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Neural and Evolutionary Computing

Title: Input anticipating critical reservoirs show power law forgetting of unexpected input events

Abstract: Usually, reservoir computing shows an exponential memory decay. This paper investigates under which circumstances echo state networks can show a power law forgetting. That means traces of earlier events can be found in the reservoir for very long time spans. Such a setting requires critical connectivity exactly at the limit of what is permissible according the echo state condition. However, for general matrices the limit cannot be determined exactly from theory. In addition, the behavior of the network is strongly influenced by the input flow. Results are presented that use certain types of restricted recurrent connectivity and anticipation learning with regard to the input, where indeed power law forgetting can be achieved.
Subjects: Neural and Evolutionary Computing (cs.NE)
Journal reference: Neural Computation May 2015, Vol. 27, No. 5: 1102-1119
Cite as: arXiv:1404.6334 [cs.NE]
  (or arXiv:1404.6334v5 [cs.NE] for this version)

Submission history

From: N. Michael Mayer [view email]
[v1] Fri, 25 Apr 2014 06:36:28 GMT (115kb,D)
[v2] Mon, 23 Jun 2014 04:28:54 GMT (231kb,D)
[v3] Wed, 15 Oct 2014 06:16:44 GMT (684kb,D)
[v4] Tue, 25 Nov 2014 10:52:02 GMT (341kb,D)
[v5] Sat, 8 Aug 2015 09:56:09 GMT (341kb,D)

Link back to: arXiv, form interface, contact.