Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning

Gyuseong Kang, Yunho Jang, Jongsun Park

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As a large number of neurons and synapses are needed in spike neural network (SNN) design, emerging devices have been employed to implement synapses and neurons. In this paper, we present a stochastic multi-bit spin orbit torque (SOT) memory based synapse, where only one SOT device is switched for potentiation and depression using modified Gray code. The modified Gray code based approach needs only N devices to represent 2N levels of synapse weights. Early read termination scheme is also adopted to reduce the power consumption of training process by turning off less associated neurons and its ADCs. For MNIST dataset, with comparable classification accuracy, the proposed SNN architecture using 3-bit synapse achieves 68.7% reduction of ADC overhead compared to the conventional 8-level synapse.

Original languageEnglish
Title of host publicationISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9781450357043
DOIs
Publication statusPublished - 2018 Jul 23
Event23rd IEEE/ACM International Symposium on Low Power Electronics and Design, ISLPED 2018 - Bellevue, United States
Duration: 2018 Jul 232018 Jul 25

Other

Other23rd IEEE/ACM International Symposium on Low Power Electronics and Design, ISLPED 2018
CountryUnited States
CityBellevue
Period18/7/2318/7/25

Fingerprint

Neurons
Orbits
Torque
Neural networks
Network architecture
Electric power utilization
Data storage equipment

Keywords

  • Neuromorphic processor
  • Spiking neural network
  • Spin orbit torque
  • STDP
  • Stochastic synapse

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Kang, G., Jang, Y., & Park, J. (2018). Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning. In ISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design [a21] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1145/3218603.3218654

Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning. / Kang, Gyuseong; Jang, Yunho; Park, Jongsun.

ISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design. Institute of Electrical and Electronics Engineers Inc., 2018. a21.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kang, G, Jang, Y & Park, J 2018, Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning. in ISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design., a21, Institute of Electrical and Electronics Engineers Inc., 23rd IEEE/ACM International Symposium on Low Power Electronics and Design, ISLPED 2018, Bellevue, United States, 18/7/23. https://doi.org/10.1145/3218603.3218654
Kang G, Jang Y, Park J. Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning. In ISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design. Institute of Electrical and Electronics Engineers Inc. 2018. a21 https://doi.org/10.1145/3218603.3218654
Kang, Gyuseong ; Jang, Yunho ; Park, Jongsun. / Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning. ISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design. Institute of Electrical and Electronics Engineers Inc., 2018.
@inproceedings{5b5d8a809a484ccda1693858bb4b4728,
title = "Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning",
abstract = "As a large number of neurons and synapses are needed in spike neural network (SNN) design, emerging devices have been employed to implement synapses and neurons. In this paper, we present a stochastic multi-bit spin orbit torque (SOT) memory based synapse, where only one SOT device is switched for potentiation and depression using modified Gray code. The modified Gray code based approach needs only N devices to represent 2N levels of synapse weights. Early read termination scheme is also adopted to reduce the power consumption of training process by turning off less associated neurons and its ADCs. For MNIST dataset, with comparable classification accuracy, the proposed SNN architecture using 3-bit synapse achieves 68.7{\%} reduction of ADC overhead compared to the conventional 8-level synapse.",
keywords = "Neuromorphic processor, Spiking neural network, Spin orbit torque, STDP, Stochastic synapse",
author = "Gyuseong Kang and Yunho Jang and Jongsun Park",
year = "2018",
month = "7",
day = "23",
doi = "10.1145/3218603.3218654",
language = "English",
isbn = "9781450357043",
booktitle = "ISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Spin orbit torque device based stochastic multi-bit synapses for on-chip STDP learning

AU - Kang, Gyuseong

AU - Jang, Yunho

AU - Park, Jongsun

PY - 2018/7/23

Y1 - 2018/7/23

N2 - As a large number of neurons and synapses are needed in spike neural network (SNN) design, emerging devices have been employed to implement synapses and neurons. In this paper, we present a stochastic multi-bit spin orbit torque (SOT) memory based synapse, where only one SOT device is switched for potentiation and depression using modified Gray code. The modified Gray code based approach needs only N devices to represent 2N levels of synapse weights. Early read termination scheme is also adopted to reduce the power consumption of training process by turning off less associated neurons and its ADCs. For MNIST dataset, with comparable classification accuracy, the proposed SNN architecture using 3-bit synapse achieves 68.7% reduction of ADC overhead compared to the conventional 8-level synapse.

AB - As a large number of neurons and synapses are needed in spike neural network (SNN) design, emerging devices have been employed to implement synapses and neurons. In this paper, we present a stochastic multi-bit spin orbit torque (SOT) memory based synapse, where only one SOT device is switched for potentiation and depression using modified Gray code. The modified Gray code based approach needs only N devices to represent 2N levels of synapse weights. Early read termination scheme is also adopted to reduce the power consumption of training process by turning off less associated neurons and its ADCs. For MNIST dataset, with comparable classification accuracy, the proposed SNN architecture using 3-bit synapse achieves 68.7% reduction of ADC overhead compared to the conventional 8-level synapse.

KW - Neuromorphic processor

KW - Spiking neural network

KW - Spin orbit torque

KW - STDP

KW - Stochastic synapse

UR - http://www.scopus.com/inward/record.url?scp=85051518763&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051518763&partnerID=8YFLogxK

U2 - 10.1145/3218603.3218654

DO - 10.1145/3218603.3218654

M3 - Conference contribution

SN - 9781450357043

BT - ISLPED 2018 - Proceedings of the 2018 International Symposium on Low Power Electronics and Design

PB - Institute of Electrical and Electronics Engineers Inc.

ER -