HackerPapers

arXiv:1603.08270cs.NE

Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computing

Steven K. Esser, Paul A. Merolla, John V. Arthur, Andrew S. Cassidy, Rathinakumar Appuswamy, Alexander Andreopoulos, David J. Berg, Jeffrey L. McKinstry, Timothy Melano, Davis R. Barch, Carmelo di Nolfo, Pallab Datta, Arnon Amir, Brian Taba, Myron D. Flickner, Dharmendra S. Modha

Abstract

Deep networks are now able to achieve human-level performance on a broad spectrum of recognition tasks. Independently, neuromorphic computing has now demonstrated unprecedented energy-efficiency through a new chip architecture based on spiking neurons, low precision synapses, and a scalable communication network. Here, we demonstrate that neuromorphic computing, despite its novel architectural primitives, can implement deep convolution networks that i) approach state-of-the-art classification accuracy across 8 standard datasets, encompassing vision and speech, ii) perform inference while preserving the hardware's underlying energy-efficiency and high throughput, running on the aforementioned datasets at between 1200 and 2600 frames per second and using between 25 and 275 mW (effectively > 6000 frames / sec / W) and iii) can be specified and trained using backpropagation with the same ease-of-use as contemporary deep learning. For the first time, the algorithmic power of deep learning can be merged with the efficiency of neuromorphic processors, bringing the promise of embedded, intelligent, brain-inspired computing one step closer.

arXiv comments
7 pages, 6 figures
Journal reference
PNAS 113 (2016) 11441-11446
DOI
doi:10.1073/pnas.1604850113
Subjects
cs.NENeural and Evolutionary Computing

On Hacker News

Linked by 3 identifiable commenters in 4 comments across 2 threads, from Feb 2017 to Feb 2017.

Comments linking this paper, per year.

Discussed in comments2 threads

    • https://arxiv.org/abs/1603.08270 They have been designed, and are being used either for more efficient pattern matching, or to speed up brain simulations (again, using known neuronal models). You seem to expect something else from neuromorphic computing, why?

      p1eskView on HNParent context

    • For training networks, designing en efficient chip is a scary proposition. However for inference tasks, low precision GEMM (as you said) goes a long way and better than what you often get. That's why chips like Movidius' Myriad are getting popular and are more similar to DSPs…

      emcqView on HNParent context

    • The reality is that TrueNorth can use CNNs and be trained with backprop to achieve good performance with networks like ImageNet despite LeCun's comments [0, 1] LeCun's primary critique is that binary wont work; "to get good results on a task like ImageNet you need about 8 bit of…

      emcqView on HNParent context

    • Yeah, this all sounds nice in practice, but look at the actual numbers: https://arxiv.org/abs/1603.08270 1) Nothing on imagenet 2) They already fall to 83% accuracy on CIFAR-10! Imagine how bad imagenet will be! If they string many chips together (exploding their power…

      deepnotderpView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.