✦ LIBER ✦

Adaptive stepsize algorithms for on-line training of neural networks

✍ Scribed by G.D. Magoulas; V.P. Plagianakos; M.N. Vrahatis

Publisher: Elsevier Science
Year: 2001
Tongue: English
Weight: 312 KB
Volume: 47
Category: Article
ISSN: 0362-546X
DOI: 10.1016/s0362-546x(01)00458-8

No coin nor oath required. For personal study only.

✦ Synopsis

In this paper a method for adapting the stepsize in on-line network training is presented. The proposed technique derives from the stochastic gradient descent proposed by Almeida et al. [On-line Learning in Neural Networks, 111-134, Cambridge University Press, 1998]. The new aspect of our approach consists in taking into consideration previously computed pieces of information regarding the adaptation of the stepsize. The proposed algorithm has been implemented, tested and compared against other on-line methods in three problems. The results shown that it behaves predictably and reliably, and possesses a satisfactory average performance.

📜 SIMILAR VOLUMES

Improvement of the backpropagation algor

Improvement of the backpropagation algorithm for training neural networks

✍ J. Leonard; M.A. Kramer 📂 Article 📅 1990 🏛 Elsevier Science 🌐 English ⚖ 444 KB

A parallel algorithm for gradient traini

A parallel algorithm for gradient training of feedforward neural networks

✍ Zdeněk Hanzálek 📂 Article 📅 1998 🏛 Elsevier Science 🌐 English ⚖ 742 KB

This paper presents a message-passing architecture simulating multilayer neural networks, adjusting its weights for each pair, consisting of an input vector and a desired output vector. First, the multilayer neural network is defined, and the difficulties arising from parallel implementation are cla

An on-line algorithm for creating self-o

An on-line algorithm for creating self-organizing fuzzy neural networks

✍ Gang Leng; Girijesh Prasad; Thomas Martin McGinnity 📂 Article 📅 2004 🏛 Elsevier Science 🌐 English ⚖ 664 KB

An on-line training radial basis functio

An on-line training radial basis function neural network for optimum operation of the UPFC

✍ M. E. A. Farrag; Ghanim Putrus 📂 Article 📅 2010 🏛 John Wiley and Sons 🌐 English ⚖ 494 KB 👁 1 views

Real-coded chaotic quantum-inspired gene

Real-coded chaotic quantum-inspired genetic algorithm for training of fuzzy neural networks

✍ Shuanfeng Zhao; Guanghua Xu; Tangfei Tao; Lin Liang 📂 Article 📅 2009 🏛 Elsevier Science 🌐 English ⚖ 690 KB

In this paper, a novel approach to adjusting the weightings of fuzzy neural networks using a Real-coded Chaotic Quantum-inspired genetic Algorithm (RCQGA) is proposed. Fuzzy neural networks are traditionally trained by using gradient-based methods, which may fall into local minimum during the learni

On a class of efficient learning algorit

On a class of efficient learning algorithms for neural networks

✍ Frank Bärmann; Friedrich Biegler-König 📂 Article 📅 1992 🏛 Elsevier Science 🌐 English ⚖ 457 KB

The ability of a neural network with one hidden layer to accurately learn a specified learning set increases with the number of nodes in the hidden layer; if a network has exactly the same number of internal nodes as the number of examples to be learnt, it is theoretically able to learn these exampl