𝔖 Bobbio Scriptorium
✦   LIBER   ✦

A short term memory for Neural Networds which allows recognition and reproduction of complex sequences of integers with the minimum number of weights

✍ Scribed by A. J. Kirke


Publisher
Springer US
Year
1996
Tongue
English
Weight
353 KB
Volume
3
Category
Article
ISSN
1370-4621

No coin nor oath required. For personal study only.

✦ Synopsis


An artificial short term memory, the binary kernel function, is presented to facilitate the learning of complex sequences of integers by Neural Networks, requiring far fewer weights than are usually needed. This is achieved by using only a single weight to encode repeat occurrences of an integer in a sequence. The coding used allows a complex sequence to be learned in only one presentation. The kernel's exponential complexity growth is overcome with hierarchical architectures which chunk the sequences to be learnt. Architectures are introduced for recognition and reproduction of complex sequences.