Numenta Demonstrates 50x Speed-Up on Deep Learning Networks Using Brain-Derived Sparse Algorithms
Channel: Numenta
Date: 2020-11-10

May 20, 2021 UPDATE: We have since achieved more than 100x speed-up on deep learning networks using our sparse algorithms, with no loss in accuracy. Read the results here: http://numenta.com/neuroscience-research/research-publications/papers/sparsity-enables-100x-performance-acceleration-deep-learning-networks

See the announcement: https://www.businesswire.com/news/home/20201110005393/en/
Read the whitepaper: https://numenta.com/assets/pdf/research-publications/papers/Sparsity-Enables-50x-Performance-Acceleration-Deep-Learning-Networks.pdf

This video walks through the results of Numenta’s technology demonstration that shows 50x performance improvements on inference tasks in deep learning networks without any loss in accuracy.
 
The advances are achieved by applying a principle of the brain called sparsity. We compared sparse and dense networks by running our algorithms on Xilinx FPGAs (Field Programmable Gate Array) for a speech recognition task using the Google Speech Commands (GSC) dataset.  Using the metric of number of words processed per second, our results show that sparse networks yield more than 50x acceleration over dense networks on a Xilinx Alveo board. 
 
Additionally, we show the GSC network running on a smaller chip where dense networks are too large to run, enabling a new set of applications that rely on low-cost, low-power solutions.
 
Lastly, we show that the sparse networks use significantly less power than the most efficient dense network.
 
This proof-of-concept demonstration validates that sparsity can achieve significant acceleration and power efficiencies for a variety of deep learning platforms and network configurations, while maintaining competitive accuracy.
 
For more technical details of this technology validation, view the white paper here: https://numenta.com/assets/pdf/research-publications/papers/Sparsity-Enables-50x-Performance-Acceleration-Deep-Learning-Networks.pdf
 
Numenta is working with strategic partners to commercialize this technology. For information, contact sparse@numenta.com.

- - - - - 
Numenta is leading the new era of machine intelligence. Our deep experience in theoretical neuroscience research has led to tremendous discoveries on how the brain works. We have developed a cohesive theory, core software technology, and numerous software applications all based on principles of the neocortex. Our innovative work delivers breakthrough capabilities and demonstrates that a computing approach based on biological learning principles can do things that today’s programmed computers cannot do. 

Subscribe to our News Digest for the latest news about neuroscience and artificial intelligence:
https://tinyurl.com/NumentaNewsDigest

Subscribe to our Newsletter for the latest Numenta updates:
https://tinyurl.com/NumentaNewsletter

Our Social Media: 
https://twitter.com/Numenta
https://www.facebook.com/OfficialNumenta
https://www.linkedin.com/company/numenta

Our Open Source Resources:
https://github.com/numenta
https://discourse.numenta.org/

Our Website: 
https://numenta.com/