Unsupervised learning for robust working memory
Authors: Jintao Gu, Sukbin Lim
Journal: PLOS Computational Biology
Accepted: 2022-03-16T00:00:00Z


Working memory is a core component of critical cognitive functions such as planning and decision-making. Persistent activity that lasts long after the stimulus offset has been considered a neural substrate for working memory. Attractor dynamics based on network interactions can successfully reproduce such persistent activity. However, it requires a fine-tuning of network connectivity, in particular, to form continuous attractors which were suggested for encoding continuous signals in working memory. Here, we investigate whether a specific form of synaptic plasticity rules can mitigate such tuning problems in two representative working memory models, namely, rate-coded and location-coded persistent activity. We consider two prominent types of plasticity rules, differential plasticity correcting the rapid activity changes and homeostatic plasticity regularizing the long-term average of activity, both of which have been proposed to fine-tune the weights in an unsupervised manner. Consistent with the findings of previous works, differential plasticity alone was enough to recover a graded-level persistent activity after perturbations in the connectivity. For the location-coded memory, differential plasticity could also recover persistent activity. However, its pattern can be irregular for different stimulus locations under slow learning speed or large perturbation in the connectivity. On the other hand, homeostatic plasticity shows a robust recovery of smooth spatial patterns under particular types of synaptic perturbations, such as perturbations in incoming synapses onto the entire or local populations. However, homeostatic plasticity was not effective against perturbations in outgoing synapses from local populations. Instead, combining it with differential plasticity recovers location-coded persistent activity for a broader range of perturbations, suggesting compensation between two plasticity rules.
Author summary: While external error and reward signals are essential for supervised and reinforcement learning, they are not always available. For example, when an animal holds a piece of information in mind for a short delay period in the absence of the original stimulus, it cannot generate an error signal by comparing its memory representation with the stimulus. Thus, it might be helpful to utilize an internal signal to guide learning that can make a system resilient. Here, we investigate the role of such unsupervised plasticity for working memory maintenance, which acts during the delay period without external inputs. We consider two prominent classes of learning rules: differential plasticity that corrects the rapid changes of instant neural activity and homeostatic plasticity that regularizes the long-term average of activity. The two learning rules have been proposed to fine-tune the synaptic weights in continuous attractor models suggested for parametric and spatial working memory. Here, we compare their performance under various network perturbations and learning parameters. The systematic studies reveal the conditions under which each rule can effectively stabilize persistent memory and suggest possible synergy between the two learning rules.