2002
2004
On the relation between slow feature analysis and independent component analysis
Tobias Blaschke
Pietro Berkes

At a first glance Slow Feature Analsysis (SFA) and Independent Component Analysis (ICA) optimize very different objectives. SFA is a nonlinear method that extracts uncorrelated slowly-varying features; ICA is a linear method that extracts statistically independent components, often based on higher-order moments and ignoring any time structure of the signals. Slowness and statistical independence are even conflicting objectives, because two slowly varying signals are more likely to be statistically dependent than quickly varying ones.

However, if one considers linear SFA and ICA based on second-order moments, one can actually relate the two algorithms quite nicely. In fact, linear SFA and second-order ICA based on correlation matrices with a time delay of one time step are equivalent to each other. This is an analytical result that provides and interesting link between two very different principles. It also provides the basis for an integration of ICA and SFA leading to an algorithm for performing nonlinear blind-source-separation, see project Independent Slow Feature Analysis and Nonlinear Blind Source Separation.

The Institut für Neuroinformatik (INI) is a research unit of the Faculty of Computer Science at the Ruhr-Universität Bochum. Its scientific goal is to understand the fundamental principles through which organisms generate behavior and cognition while linked to their environments through sensory and effector systems. Inspired by our insights into such natural cognitive systems, we seek new solutions to problems of information processing in artificial cognitive systems. We draw from a variety of disciplines that include experimental psychology and neurophysiology as well as machine learning, neural artificial intelligence, computer vision, and robotics.

Universitätsstr. 150, Building NB, Room 3/32
D-44801 Bochum, Germany

Tel: (+49) 234 32-28967
Fax: (+49) 234 32-14210