Step acceleration based training algorithm for feedforward neural networks

2003 ◽  
Author(s):  
Yanlai Li ◽  
Kuanquan Wang ◽  
D. Zhang
Keyword(s):  
Neural Networks ◽  
Feedforward Neural Networks ◽  
Training Algorithm

scholarly journals Learning in Feedforward Neural Networks Accelerated by Transfer Entropy

Entropy ◽  
2020 ◽  
Vol 22 (1) ◽  
pp. 102 ◽  
Author(s):  
Adrian Moldovan ◽  
Angel Caţaron ◽  
Răzvan Andonie
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Information Transfer ◽  
Feedforward Neural Networks ◽  
Theoretical Method ◽  
Transfer Entropy ◽  
Training Algorithms ◽  
Training Algorithm ◽  
Neural Connections ◽  
Feedback Connections

Current neural networks architectures are many times harder to train because of the increasing size and complexity of the used datasets. Our objective is to design more efficient training algorithms utilizing causal relationships inferred from neural networks. The transfer entropy (TE) was initially introduced as an information transfer measure used to quantify the statistical coherence between events (time series). Later, it was related to causality, even if they are not the same. There are only few papers reporting applications of causality or TE in neural networks. Our contribution is an information-theoretical method for analyzing information transfer between the nodes of feedforward neural networks. The information transfer is measured by the TE of feedback neural connections. Intuitively, TE measures the relevance of a connection in the network and the feedback amplifies this connection. We introduce a backpropagation type training algorithm that uses TE feedback connections to improve its performance.

scholarly journals Training Feedforward Neural Networks Using Symbiotic Organisms Search Algorithm

2016 ◽  
Vol 2016 ◽  
pp. 1-14 ◽  
Author(s):  
Haizhou Wu ◽  
Yongquan Zhou ◽  
Qifang Luo ◽  
Mohamed Abdel Basset
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Search Algorithm ◽  
Feedforward Neural Networks ◽  
Metaheuristic Algorithm ◽  
Training Algorithm ◽  
Symbiotic Interaction ◽  
Symbiotic Organisms Search ◽  
Symbiotic Organisms ◽  
Better Than

Symbiotic organisms search (SOS) is a new robust and powerful metaheuristic algorithm, which stimulates the symbiotic interaction strategies adopted by organisms to survive and propagate in the ecosystem. In the supervised learning area, it is a challenging task to present a satisfactory and efficient training algorithm for feedforward neural networks (FNNs). In this paper, SOS is employed as a new method for training FNNs. To investigate the performance of the aforementioned method, eight different datasets selected from the UCI machine learning repository are employed for experiment and the results are compared among seven metaheuristic algorithms. The results show that SOS performs better than other algorithms for training FNNs in terms of converging speed. It is also proven that an FNN trained by the method of SOS has better accuracy than most algorithms compared.

A new robust training algorithm for a class of single-hidden layer feedforward neural networks

2011 ◽  
Vol 74 (16) ◽  
pp. 2491-2501 ◽  
Author(s):  
Zhihong Man ◽  
Kevin Lee ◽  
Dianhui Wang ◽  
Zhenwei Cao ◽  
Chunyan Miao
Keyword(s):  
Neural Networks ◽  
Feedforward Neural Networks ◽  
Training Algorithm ◽  
Hidden Layer

A hybrid linear/nonlinear training algorithm for feedforward neural networks

1998 ◽  
Vol 9 (4) ◽  
pp. 669-684 ◽  
Author(s):  
S. McLoone ◽  
M.D. Brown ◽  
G. Irwin ◽  
A. Lightbody
Keyword(s):  
Neural Networks ◽  
Feedforward Neural Networks ◽  
Training Algorithm
Sign in / Sign up

Export Citation Format

Share Document