A cascade associative memory model with a hierarchical memory structure
β Scribed by Makoto Hirahara; Natsuki Oka; Toshiki Kindo
- Publisher
- Elsevier Science
- Year
- 2000
- Tongue
- English
- Weight
- 290 KB
- Volume
- 13
- Category
- Article
- ISSN
- 0893-6080
No coin nor oath required. For personal study only.
β¦ Synopsis
The introduction of a hierarchical memory structure into a cascade associative memory model for storing hierarchically correlated patterns improves the storage capacity and the size of the basins of attraction remarkably. A learning algorithm groups descendants (second-level patterns) according to their ancestors (first-level ones), and organizes the memory structure in a weight matrix where the groups are memorized separately. The weight matrix is, thus, in the form of a pile of covariance matrices, each of which is responsible for recalling only the descendants of each ancestor. Putting it simply, the model is multiplex associative memory. The recalling process proceeds as follows: the model first recalls the ancestor of a target descendant. Then, the dynamics with dynamic threshold combines the ancestor and the weight matrix to activate the covariance matrix for recalling only the descendants of the ancestor. This mechanism suppresses the cross-talk noise generated by the descendants of the other ancestors, and the recalling ability is enhanced.
π SIMILAR VOLUMES
In conventional models for storing hierarchically correlated patterns, correlations between ancestors (first-level patterns) and their descendants (second-level ones) are assumed to be uniform, so that the descendants are distributed around their ancestors with equal distances. However, this assumpt
We present a new associative memory model based on the Hamming memory, but where the winner-take-all network part is replaced by a layer of nodes with somewhat complex node functions. This new memory can produce output vectors with individual "don't know" bits. The simulations demonstrate that this
## αΊe present a new associative memory model that stores arbitrary bipolar patterns without the problems we can find in other models like BAM or LAM. After identifying those problems we show the new memory topology and we explain its learning and recall stages. Mathematical demonstrations are provi
This paper proposes a new correlation matrix network model of associative memory in brain. Each memorized pattern which consists of binary (+1 or -1) elements is preprocessed by a quantized Hadamard transform to increase selectivity. The association ability of a correlation matrix network model depe