An Energy-Quality Scalable STDP Based Sparse Coding Processor with On-Chip Learning Capability

Heetak Kim, Hoyoung Tang, Woong Choi, Jongsun Park

Research output: Contribution to journalArticle

Abstract

Two main bottlenecks encountered when implementing energy-efficient spike-timing-dependent plasticity (STDP) based sparse coding, are the complex computation of winner-take-all (WTA) operation and repetitive neuronal operations in the time domain processing. In this article, we present an energy-efficient STDP based sparse coding processor. The low-cost hardware is based on the algorithmic reduction techniques as following: First, the complex WTA operation is simplified based on the prediction of spike emitting neurons. Sparsity based approximation in spatial and temporal domain are also efficiently exploited to remove the redundant neurons with negligible algorithmic accuracy loss. We designed and implemented the hardware of the STDP based sparse coding using 65nm CMOS process. By exploiting input sparsity, the proposed SNN architecture can dynamically trade off algorithmic quality for computation energy (up to 74%) for Natural image (maximum 0.01 RMSE increment) and MNIST (no accuracy loss) applications. In the inference mode of operations, the SNN hardware achieves the throughput of 374 Mpixels/s and 840.2 GSOP/s with the energy-efficiency of 781.52 pJ/pixel and 0.35 pJ/SOP.

Original languageEnglish
Article number8949731
Pages (from-to)125-137
Number of pages13
JournalIEEE Transactions on Biomedical Circuits and Systems
Volume14
Issue number1
DOIs
Publication statusPublished - 2020 Feb 1
Externally publishedYes

Keywords

  • Neuromorphic system
  • on-chip learning
  • sparse coding
  • spike timing dependent plasticity (STDP)
  • spiking neural network

ASJC Scopus subject areas

  • Biomedical Engineering
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'An Energy-Quality Scalable STDP Based Sparse Coding Processor with On-Chip Learning Capability'. Together they form a unique fingerprint.

  • Cite this