Continual Lifelong Learning Paper Review / Jeff Hawkins on Grid Cell Modules - February 10, 2021
Channel: Numenta
Date: 2021-02-10

Karan Grewal gives an overview of the paper “Continual Lifelong Learning with Neural Networks: A Review” by German Parisi, et al.. He first explains three main areas of current continual learning approaches. Then, he outlines four research areas that the authors advocate will be crucial to developing lifelong learning agents.

In the second part, Jeff Hawkins discusses new ideas and improvements from our previous "Frameworks" paper. He proposes a more refined grid cell module where each layer of minicolumns contains a 1D voltage-controlled oscillating module that represents movement in a particular direction. Jeff first explains the mechanisms within each column and how anchoring occurs in grid cell modules. He then gives an overview on displacement cells and deduces that if we have 1D grid cell modules, it is very likely that there are 1D displacement cell modules. Furthermore, he makes the case that the mechanisms for orientation cells are analogous to that of grid cells. He argues that each minicolumn is driven by various 1D modules that represent orientation and location and are the forces behind a classic grid cell / orientation cell module. 

“Continual Lifelong Learning with Neural Networks: A Review” by German Parisi, et al.. : https://www.sciencedirect.com/science/article/pii/S0893608019300231
"A Framework for Intelligence and Cortical Function Based on Grid Cells in the Neocortex" paper: https://www.frontiersin.org/articles/10.3389/fncir.2018.00121/full

0:00 Continual Lifelong Learning Paper Review
40:55 Jeff Hawkins on Grid Cell Modules
- - - - - 
Numenta is leading the new era of machine intelligence. Our deep experience in theoretical neuroscience research has led to tremendous discoveries on how the brain works. We have developed a framework called the Thousand Brains Theory of Intelligence that will be fundamental to advancing the state of artificial intelligence and machine learning. By applying this theory to existing deep learning systems, we are addressing today’s bottlenecks while enabling tomorrow’s applications. 

Subscribe to our News Digest for the latest news about neuroscience and artificial intelligence:
https://tinyurl.com/NumentaNewsDigest

Subscribe to our Newsletter for the latest Numenta updates:
https://tinyurl.com/NumentaNewsletter

Our Social Media: 
https://twitter.com/Numenta
https://www.facebook.com/OfficialNumenta
https://www.linkedin.com/company/numenta

Our Open Source Resources:
https://github.com/numenta
https://discourse.numenta.org/

Our Website: 
https://numenta.com/