From: das@CS.ColoState.EDU (rajarshi das)
Subject: Kanerva's SDM
Date: Sun, 08 Nov 1992 00:36:24 GMT
Organization: Colorado State University, Computer Science Department


In <1992Nov4.205034.16263@fripp.ri.cadre.com> umn@cadre.com 
(Uttam M. Narsu) writes:

>I haven't heard much about Kanerva's work since I read 'Sparse Distributed 
>Memory' many years ago. What's the consensus on his work? Has anyone 
>implemented an SDM in software or hardware?

Several papers on SDM have been published in the last couple of years.  
I have appended a list of such papers that I have been able to trace.

We have done some work with Sparse Distributed Memory (SDM) recently.
Our work concentrated on modifying the SDM with the help of a genetic
algorithm (GA).   David Rogers had earlier shown that a GA can be used
to optimize the "location address space" in an SDM (which corresponds
to the mapping from the input layer to the hidden units in a neural 
network).  We have further extended this method, and have obtained
improved performance.  The results of our work, "Genetic Sparse 
Distributed Memory,"  has been published in IJCNN-COGANN (Combination 
of Genetic Algorithm and Neural Networks), 1992.

	Rajarshi Das


	List of papers on SDM follows:
	-----------------------------

\bibitem{Chou} Chou, P. A.
The Capacity of the Kanerva Associative Memory.
{\em IEEE Transactions on the Information Theory}, Vol. 35, No. 2, March 1989.

\bibitem{Clarke} Clarke T.J.W., Prager R.W.,  \& Fallside F. (1991).
The Modified Kanerva Model: Theory and Results for Real-time Word
Recognition. {\em IEEE Proceedings-F}, Vol. 138, No. 1.

\bibitem{Das_Whitley} Das, Rajarshi, and Whitley, Darrell.
{\em Genetic Sparse Distributed Memory}.
IJCNN-COGANN (Combination of Genetic Algorithm and Neural Networks), 1992.

\bibitem{Denning} Denning, P. J. (1990).
The Science of Computing: Saving All the Bits.
{\em American Scientist}, Vol. 78, No. 5.

\bibitem{Hong} Hong, Y., \& Chen, S. (1991).
Character Recognition in a Sparse Distributed Memory.
{\em IEEE Transactions on Systems, Man, and Cybernetics}, Vol. 21, No. 3.

\bibitem{Rogers1} Rogers, D. (1990).
Predicting Weather Using a Genetic Memory: a Combination of Kanerva's
Sparse Distributed Memory with Holland's Genetic Algorithm.
{\em Advances in Neural Information Processing-2}.

\bibitem{Rogers2} Rogers, D. (1991).
Weather Prediction Using a Genetic Memory.
{\em Neural Networks: Concepts, Applications and Implementations}, Vol. 4,
Antognetti, P (Editor); Prentice Hall.

\bibitem{Surkan} Surkan, A. J., \&  Di, L. (1989). 
Fast Trainable Pattern Classification by a Modification of Kanerva's SDM 
Model (pp. I-347-349). {\em IJCNN-1989}.

\bibitem{Tsai} Tsai, W. K., Parlos, A., \& Fernandez, B. (1990).
ASDM- A Novel Neural Network Model based on Sparse Distributed Memory
(pp. I-771-776). {\em IJCNN-1990-SAN DIEGO}.

===============================================================================
        Rajarshi Das				 das@brahms.cs.colostate.edu
        Computer Science Department		 raja@lamar.colostate.edu
        Colorado State University		 
	Colorado 80523
===============================================================================
Newsgroups: comp.ai.neural-nets