Enhancing matrix multiplication with a monolithic 3-D-based scratchpad memory

Cong Thuan Do, Jeong Hwan Choi, Young Seo Lee, Cheol Hong Kim, Sung Woo Chung

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Convolutional neural networks (CNNs) are one of the most popular machine learning algorithms. The convolutional layers, which account for the most execution time of CNNs, are implemented with matrix multiplication because the convolution operation performs dot products between filters and local regions of the input. On the other hand, GPUs with thousands of cores were proven to significantly accelerate matrix multiplication, compared to CPUs with a limited number of cores, especially for large matrices. However, the current memory architecture allows only one row access at a time so that multiple accesses are necessary to read the column data of the second matrix, thus slowing down matrix multiplication. In this study, we adopt the monolithic 3-D integration for the GPU scratchpad memory, called monolithic 3-D integration (M3D) scratchpad memory (SPM), to enhance matrix multiplication. The M3D SPM allows one access to read the column data of the second matrix, similar to the case of the first matrix. The simulation results show that our M3D SPM improves the system performance by 46.3% for the 32 × 32 matrix multiplication, over the conventional 2-D SPM where the column data of the second matrix are read sequentially.

Original languageEnglish
Article number9115599
Pages (from-to)57-60
Number of pages4
JournalIEEE Embedded Systems Letters
Volume13
Issue number2
DOIs
Publication statusPublished - 2021 Jun

Keywords

  • High performance
  • matrix multiplication
  • monolithic 3-D
  • neural network
  • scratchpad memory (SPM)

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Enhancing matrix multiplication with a monolithic 3-D-based scratchpad memory'. Together they form a unique fingerprint.

Cite this