In Lateral Interactions in the Cortex: Structure and Function, eds. J. Sirosh, R. Miikkulainen, and Y. Choe, publ. The UTCS Neural Networks Research Group, Austin, TX, electronic book, ISBN 0-9647060-0-8, http://nn.cs.utexas.edu/web-pubs/htmlbook96/, Chapter 11 (1996) (bibtex, paper, paper.ps.gz)

Face recognition by dynamic link matching.

Laurenz Wiskott and Christoph von der Malsburg


Abstract: We present a neural system for the recognition of objects from realistic images, together with results of tests of face recognition from a large gallery. The system is inherently invariant with respect to shift, and is robust against many other variations, most notably rotation in depth and deformation. The system is based on Dynamic Link Matching. It consists of an image domain and a model domain, which we tentatively identify with primary visual cortex and infero-temporal cortex. Both domains have the form of neural sheets of hypercolumns, which are composed of simple feature detectors (modeled as Gabor-based wavelets). Each object is represented in memory by a separate model sheet, that is, a two-dimensional array of features. The match of the image to the models is performed by network self-organization, in which rapid reversible synaptic plasticity of the connections ("dynamic links") between the two domains is controlled by signal correlations, which are shaped by fixed inter-columnar connections and by the dynamic links themselves. The system requires very little genetic or learned structure, relying essentially on the rules of rapid synaptic plasticity and the a priori constraint of preservation of topography to find matches. This constraint is encoded within the neural sheets with the help of lateral connections, which are excitatory over short range and inhibitory over long range.

Keywords: neural networks, dynamic link matching, face recognition, translation invariance, window of attention


Relevant Project:


May 7, 1996, Laurenz Wiskott, http://www.neuroinformatik.ruhr-uni-bochum.de/PEOPLE/wiskott/