DC Field | Value | Language |
dc.contributor.author | Kovac, Andre David | |
dc.contributor.author | Koall, Maximilian | |
dc.contributor.author | Pipa, Gordon | |
dc.contributor.author | Toutounji, Hazem | |
dc.date.accessioned | 2021-12-23T16:13:41Z | - |
dc.date.available | 2021-12-23T16:13:41Z | - |
dc.date.issued | 2016 | |
dc.identifier.issn | 19326203 | |
dc.identifier.uri | https://osnascholar.ub.uni-osnabrueck.de/handle/unios/10692 | - |
dc.description.abstract | Delays are ubiquitous in biological systems, ranging from genetic regulatory networks and synaptic conductances, to predator/pray population interactions. The evidence is mounting, not only to the presence of delays as physical constraints in signal propagation speed, but also to their functional role in providing dynamical diversity to the systems that comprise them. The latter observation in biological systems inspired the recent development of a computational architecture that harnesses this dynamical diversity, by delay-coupling a single nonlinear element to itself. This architecture is a particular realization of Reservoir Computing, where stimuli are injected into the system in time rather than in space as is the case with classical recurrent neural network realizations. This architecture also exhibits an internal memory which fades in time, an important prerequisite to the functioning of any reservoir computing device. However, fading memory is also a limitation to any computation that requires persistent storage. In order to overcome this limitation, the current work introduces an extended version to the single node Delay-Coupled Reservoir, that is based on trained linear feedback. We show by numerical simulations that adding task-specific linear feedback to the single node Delay-Coupled Reservoir extends the class of solvable tasks to those that require nonfading memory. We demonstrate, through several case studies, the ability of the extended system to carry out complex nonlinear computations that depend on past information, whereas the computational power of the system with fading memory alone quickly deteriorates. Our findings provide the theoretical basis for future physical realizations of a biologically-inspired ultrafast computing device with extended functionality. | |
dc.description.sponsorship | Deutsche Forschungsgemeinschaft (DFG)German Research Foundation (DFG); Open Access Publishing Fund of Osnabruck University; European project PHOCUS [FP7-ICT-2009-C, 240763]; The authors acknowledge the financial support by Deutsche Forschungsgemeinschaft (DFG) and Open Access Publishing Fund of Osnabruck University, in addition to the European project PHOCUS in the Framework `Information and Communication Technologies' (FP7-ICT-2009-C / Proposal Nr. 240763) | |
dc.language.iso | en | |
dc.publisher | PUBLIC LIBRARY SCIENCE | |
dc.relation.ispartof | PLOS ONE | |
dc.subject | COMPUTATION | |
dc.subject | DYNAMICS | |
dc.subject | FADING MEMORY | |
dc.subject | HOMEOSTATIC PLASTICITY | |
dc.subject | INFORMATION | |
dc.subject | MODEL | |
dc.subject | Multidisciplinary Sciences | |
dc.subject | NETWORKS | |
dc.subject | Science & Technology - Other Topics | |
dc.subject | TIME | |
dc.title | Persistent Memory in Single Node Delay-Coupled Reservoir Computing | |
dc.type | journal article | |
dc.identifier.doi | 10.1371/journal.pone.0165170 | |
dc.identifier.isi | ISI:000389602800062 | |
dc.description.volume | 11 | |
dc.description.issue | 10 | |
dc.contributor.orcid | 0000-0002-6831-0916 | |
dc.publisher.place | 1160 BATTERY STREET, STE 100, SAN FRANCISCO, CA 94111 USA | |
dcterms.isPartOf.abbreviation | PLoS One | |
dcterms.oaStatus | Green Published, Green Submitted, gold | |
crisitem.author.dept | Institut für Kognitionswissenschaft | - |
crisitem.author.deptid | institute28 | - |
crisitem.author.orcid | 0000-0002-3416-2652 | - |
crisitem.author.parentorg | FB 08 - Humanwissenschaften | - |
crisitem.author.grandparentorg | Universität Osnabrück | - |
crisitem.author.netid | PiGo340 | - |