Stochastic SOT device based SNN architecture for On-chip Unsupervised STDP Learning

Yunho Jang, Gyuseong Kang, Taehwan Kim, Yeongkyo Seo, Kyung Jin Lee, Byong Guk Park, Jongsun Park

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Emerging device based spiking neural network (SNN) hardware design has been actively studied. Especially, energy and area efficient synapse crossbar has been of particular interest, but processing units for weight summations in synapse crossbar are still a main bottleneck for energy and area efficient hardware design. In this paper, we propose an efficient SNN architecture with stochastic spin-orbit torque (SOT) device based multi-bit synapses. First, we present SOT device based synapse array using modified gray code. The modified gray code based synapse needs only N devices to represent 2^N levels of synapse weights. Accumulative spike technique is also adopted in the proposed synapse array, to improve ADC utilization and reduce the number of neuron updates. In addition, we propose hardware friendly algorithmic techniques to improve classification accuracies as well as energy efficiencies. Non-spike depression based stochastic spike-timing-dependent plasticity is used to reduce the overlapping input representation and classification error. Early read termination is also employed to reduce energy consumption by turning off less associated neurons. The proposed SNN processor has been implemented using 65nm CMOS process, and it shows 90% classification accuracy in MNIST dataset consuming 0.78J/image (training) and 0.23J/image (inference) of energy with an area of 1.12mm2.

Original languageEnglish
JournalIEEE Transactions on Computers
DOIs
Publication statusAccepted/In press - 2021

Keywords

  • Computer architecture
  • Hardware
  • Magnetic tunneling
  • Magnetization
  • Neurons
  • on-chip learning
  • spiking neural network
  • Spin-orbit torque device
  • stochastic spike-timing-dependent plasticity
  • Switches
  • Synapses

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Hardware and Architecture
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'Stochastic SOT device based SNN architecture for On-chip Unsupervised STDP Learning'. Together they form a unique fingerprint.

Cite this