Mapping of neural network models onto two-dimensional processor arrays

✍ Scribed by Rabi N. Mahapatra; Sudipta Mahapatra

• Publisher: Elsevier Science
• Year: 1996
• Tongue: English
• Weight: 819 KB
• Volume: 22
• Category: Article
• ISSN: 0167-8191
• DOI: 10.1016/s0167-8191(96)00048-8

✦ Synopsis

Proper implementation strategies should be followed to fully exploit the potential of artificial neural nets (ANNs). This in turn depends on the selection of an appropriate mapping scheme, especially while implementing neural nets in parallel processing environment. In this paper, we discuss the mapping of ANNs onto two-dimensional processor arrays. It has been shown that by following a diagonal assignment of the neurons and by suitably distributing the weight values across the array, computations involved in the operation of neural nets can be carried out with minimum communication overhead. The mapping has been illustrated on two popular neural net models: the Hopfield net and the multilayer perceptron (MLP) with back-propagation learning.

One iteration of an n neuron Hopfield net takes 4(P -~).

[n/~l unit shifts in a P X P processor array. For the same target architecture, a single iteration of back-propagation learning on an MLP of n neurons takes a maximum of 8(P -l).ln/P] shifts.