Dimensionality and Sparsity in Deep Learning Networks - January 20, 2021
Channel: Numenta
Date: 2021-01-22

Subutai Ahmad goes through the framework and results of a study he conducted on dimensionality and sparsity in a deep learning network. Using the GSC dataset, he explores the correlation between dimensionality and the size and accuracy of sparse networks. He also assesses whether there are scaling laws for sparsity in deep learning, similar to the mathematical algorithms for sparse distributed representations in the brain. 

“How Can We Be So Dense? The Benefits of Using Highly Sparse Representations” paper: https://arxiv.org/abs/1903.11257
- - - - - 
Numenta is leading the new era of machine intelligence. Our deep experience in theoretical neuroscience research has led to tremendous discoveries on how the brain works. We have developed a framework called the Thousand Brains Theory of Intelligence that will be fundamental to advancing the state of artificial intelligence and machine learning. By applying this theory to existing deep learning systems, we are addressing today’s bottlenecks while enabling tomorrow’s applications. 

Subscribe to our News Digest for the latest news about neuroscience and artificial intelligence:
https://tinyurl.com/NumentaNewsDigest

Subscribe to our Newsletter for the latest Numenta updates:
https://tinyurl.com/NumentaNewsletter

Our Social Media: 
https://twitter.com/Numenta
https://www.facebook.com/OfficialNumenta
https://www.linkedin.com/company/numenta

Our Open Source Resources:
https://github.com/numenta
https://discourse.numenta.org/

Our Website: 
https://numenta.com/