Template-based procedures for neural network interpretation
β Scribed by J.A. Alexander; M.C. Mozer
- Publisher
- Elsevier Science
- Year
- 1999
- Tongue
- English
- Weight
- 202 KB
- Volume
- 12
- Category
- Article
- ISSN
- 0893-6080
No coin nor oath required. For personal study only.
β¦ Synopsis
Although neural networks often achieve impressive learning and generalization performance, their internal workings are typically all but impossible to decipher. This characteristic of the networks, their opacity, is one of the disadvantages of connectionism compared to more traditional, rule-oriented approaches to artificial intelligence. Without a thorough understanding of the network behavior, confidence in a system's results is lowered, and the transfer of learned knowledge to other processing systems -including humans -is precluded. Methods that address the opacity problem by casting network weights in symbolic terms are commonly referred to as rule extraction techniques. This work describes a principled approach to symbolic rule extraction from standard multilayer feedforward networks based on the notion of weight templates, parameterized regions of weight space corresponding to specific symbolic expressions. With an appropriate choice of representation, we show how template parameters may be efficiently identified and instantiated to yield the optimal match to the actual weights of a unit. Depending on the requirements of the application domain, the approach can accommodate n-ary disjunctions and conjunctions with O(k) complexity, simple n-of-m expressions with O(k 2 ) complexity, or more general classes of recursive n-of-m expressions with O(k LΟ©2 ) complexity, where k is the number of inputs to an unit and L the recursion level of the expression class. Compared to other approaches in the literature, our method of rule extraction offers benefits in simplicity, computational performance, and overall flexibility. Simulation results on a variety of problems demonstrate the application of our procedures as well as the strengths and the weaknesses of our general approach.
π SIMILAR VOLUMES
This paper describes a neural network graph partitioning algorithm which partitions unstructured ΓΏnite element/volume meshes as a precursor to a parallel domain decomposition solution method. The algorithm works by ΓΏrst constructing a coarse graph approximation using an automatic graph coarsening me
## Abstract Stable cellular neural networks with binary outputs implement a nonβlinear mapping between sets of input and output images. Such a mapping is studied in detail. We prove two theorems: the first one yields a sufficient condition in order that the nonβlinear mapping be wellβdefined; the s
This paper presents image thinning algorithms using cellular neural networks (CNNs) with one-or two-dimensional opposite-sign templates (OSTs) as well as non-unity gain output functions. Two four-layer CNN systems with one-dimensional (1-D) OSTs are proposed for image thinning with 4-or 8-connectivi