Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/39031
Title: | On the Performance of the Nonsynaptic Backpropagation for Training Long-term Cognitive Networks | Authors: | NAPOLES RUIZ, Gonzalo Grau, I. CONCEPCION PEREZ, Leonardo Salgueiro, Yamisleydi |
Issue Date: | 2021 | Publisher: | Institution of Engineering and Technology | Source: | Proceedings of the 11th International Conference on Pattern Recognition Systems, Institution of Engineering and Technology, p. 25 -30 | Abstract: | Long-term Cognitive Networks (LTCNs) are recurrent neural networks for modeling and simulation. Such networks can be trained in a synaptic or non-synaptic mode according to their goal. Non-synaptic learning refers to adjusting the transfer function parameters while preserving the weights connecting the neurons. In that regard, the Non-synaptic Backpropagation (NSBP) algorithm has proven successful in training LTCN-based models. Despite NSBP’s success, a question worthy of investigation is whether the backpropagation process is necessary when training these recurrent neural networks. This paper investigates this issue and presents three non-synaptic learning methods that modify the original algorithm. In addition, we perform a sensitivity analysis of both the NSBP’s hyperparameters and the LTCNs’ learnable parameters. The main conclusions of our study are i) the backward process attached to the NSBP algorithm is not necessary to train these recurrent neural systems, and ii) there is a non-synaptic learnable parameter that does not contribute significantly to the LTCNs’ performance. | Keywords: | NSBP algorithm;recurrent neural systems;nonsynaptic learnable parameter;synaptic mode;nonsynaptic mode;transfer function parameters;nonsynaptic backpropagation algorithm;LTCN based models;backpropagation process;recurrent neural networks;nonsynaptic learning;hyperparameters;long-term cognitive networks;learnable parameters | Document URI: | http://hdl.handle.net/1942/39031 | ISBN: | 978-1-83953-430-0 | DOI: | 10.1049/icp.2021.1434 | Category: | C1 | Type: | Proceedings Paper |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
On_the_Performance_of_the_Nonsynaptic_Backpropagation_for_Training_Long-term_Cognitive_Networks.pdf Restricted Access | Published version | 164.02 kB | Adobe PDF | View/Open Request a copy |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.