Abstract:
The hippocampus is a brain structure that is instrumental for episodic memory, i.e. for memorizing facts and events. It is often thought to be an intermediate memory that can store new input patterns quickly, which subsequently get transferred into more permanent cortical memory. The entorhinal cortex serves as an interface between hippocampus and other cortical areas. Within the hippocampal formation the different substructures form a loop: entorhinal cortex (layers II/III) - dentate gyrus - CA3 - CA1 - subiculum - entorhinal cortex (layers V/VI). Because of its recurrent connectivity, CA3 is thought to be the actual memory. Dentate gyrus would then be an encoding network, preparing the input patterns for storage in CA3; CA1 and subiculum would perform the decoding to reconstruct the stored patterns in entorhinal cortex.
The dentate gyrus is special in that it generates new neurons throughout life, a phenomenon referred to as adult neurogenesis. Why does adult neurogenesis occur in the dentate gyrus and not in any of the other structures? Assume the dentate gyrus adapts to the environment the animal lives in in order to optimize its encoding for the input-pattern distribution encountered in this environment. If the animal moves to another environment, new adaptation takes place and the dentate gyrus is faces with the problem of catastrophic interference. As a new encoding is learned the old encoding degrades quickly and as a consequence old patterns could not be addressed and retrieved from the CA3-memory. In artificial neural networks catastrophic interference is usually avoided by interleaved training, i.e. the training patterns are presented repeatedly in an alternating fashion. However, this is not possible in real life, because many patterns occur only once. How can the dentate gyrus solve this problem?
We hypothesize that new neurons are the solution to this problem. If the dentate gyrus keeps old neurons and their connections fixed but adds new neurons that are plastic, it can adapt to qualitatively new input patterns but at the same time maintain the encoding capabilities for old patterns. Note that new neurons are required only for qualitatively new patterns and not for new patterns that belong to the old input distribution, because we assume the encoding to be characteristic for a distribution and not for individual patterns.
As a proof of principle we have simulated a linear auto-encoder network
modelling the loop within the hippocampal formation. We assume that the
animal first lives in environment A with a certain input-pattern
statistics, then moves to a new environment B with a different
input-pattern statistics, and finally returns to environment A. We assume
that the animal has time to adapt to environment A and then B, but when it
returns to A we only test the performance without giving the time for new
adaptation. We also assume that the decoding (CA1/subiculum) stays plastic
and can adapt to environment A and B in any case (but not when the animal
returns to A). We have considered three different scenarios:
(a) No DG-adaptation: The dentate gyrus adapts to environment A and keeps
the synaptic weights fixed after that. No adaptation to environment B
occurs.
(b) Neurogenesis: The dentate gyrus starts with fewer units and first
adapts to environment A. In environment B the old units and connections
are fixed but a few new units are added and used to adapt to the new
input-pattern distribution.
(c) Full adaptation: The dentate gyrus always fully adapts to the current
environment, first A then B.
In the simulations we find that the networks always perform reasonably well on the pattern distributions they are adapted to. However, in scenario (a) the performance is poor in environment B, because although the decoding can adapt to environment B the encoding is still optimal for A and misses important dimensions of B. Performance is also poor when the animal returns to A, because the decoding has adapted to B. In scenario (c) performance is particularly poor when the animal returns to environment A, because the network is then fully adapted to B. Only in scenario (b) is the effect of catastrophic interference largely avoided and the performance good in environments A and B and also as the animal returns to A.
Our model is consistent with a number of anatomical and physiological
facts:
New neurons are found to be more plastic than old ones as required by our
model.
Since new units are only required for qualitatively new input patterns,
there is decreasing need for neurogenesis with age, because the animal has
more and more experience and encounters fewer and fewer qualitatively new
stimuli. This is consistent with the decrease in neurogenesis observed
experimentally.
A relatively small number of newly added units can have a large effect,
since only missing dimensions have to be newly encoded. This is
consistent with the relatively low level of neurogenesis of 30% new
neurons in mice over the whole lifetime.
Since the generation of new neurons takes weeks but the demand for new
neurons can be on a much shorter time scale when the animal changes its
environment, it is reasonable that new neurons are generated all the time
to have some in stock when needed. New neurons not needed die after some
time. This is what is found experimentally.
The level of neurogenesis is regulated by rather unspecific factors such
as physical activity or hunger. It is clear that if new neurons are only
needed if qualitatively new input-pattern distributions are encountered,
there are no specific factors that would be available early enough. Thus
the unspecific factors might actually be fairly descent predictors for the
need of new neurons, since hunger and running fosters exploration of new
environments.
In summary we hypothesize that adult neurogenesis in the dentate gyrus helps to solve the problem of catastrophic interference when an animal adapts to new environments. Our network simulations confirm that adding new neurons can reduce the effect of catastrophic interference significantly. The model is also qualitatively consistent with a number of anatomical and physiological facts about adult neurogenesis.
See http://cogprints.org/4012/ for more information.